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Abstract. For the group G = PGL2 we prove nonstandard matching 
and the fundamental lemma between two relative trace formulas: on 
one hand, the relative trace formula of Jacquet for the quotient T\G/T, 
where T is a nontrivial torus; on the other, the Kuznetsov trace formula 
with nonstandard test functions. The matching is nonstandard in the 
sense that orbital integrals are related to each other not one-by-one, 
but via an explicit integral transform. These results will be used in 
[Saka] to compare the corresponding global trace formulas and reprove 
the celebrated result of Waldspurger [Wal85] on toric periods. 
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1. Introduction 

1.1. With the present paper I launch an investigation of new ways to com- 
pare trace formulas in the field of automorphic forms, as a means of proving 
explicit relations between the spectra of two relative trace formulas (RTFs) 
- which is translated to relations between periods of automorphic forms. 
Such relations are predicted, in great generality, by the generalization of the 
Gross-Prasad-Ichino-Ikeda conjecture [IIIO] which is to appear in my joint 
work with Venkatesh [SV], and while the general conjecture is not yet very 
detailed, many special cases suggest the relevance of the RTF in formulat- 
ing a detailed conjecture: the conjecture is not really about a single pair 
(G, H) consisting of a group and a subgroup, not even about the quotient 
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space X = H\G, but it involves certain "pure inner forms" of the pair 
(G, H) which can be understood in terms of the algebraic stack H\G/H 
(equivalently: X x X/G). On the other hand, the relative trace formula, as 
currently being used following the paradigm of endoscopy for the Arthur- 
Selberg trace formula, seems to have no hope of proving relations in such 
generality, for reasons that will be explained below. Thus, we need new 
ways to compare trace formulas, which is what I am doing in the present 
paper, for two periods about which virtually everything is already known: 
the Whittaker period and the torus period, both for the group PGL2. The 
continuation of the present paper in [Saka] will provide a new proof of the 
celebrated result of Waldspurger on toric periods of automorphic forms. 

The topic of interest should not be seen as restricted to the study of 
periods and hence as something separate from the mainstream Langlands 
program. Indeed, the relative trace formula should be considered a potential 
generalization of the Arthur-Selberg trace formula (before stabilization), and 
the nonstandard comparison performed here is certainly within the spirit of 
the ambitious "beyond endoscopy" program proposed by Langlands [Lan04] . 
The difference lies in the level of ambition and difficulty: while Langlands 
wants to filter out only part of the spectrum of a trace formula by taking 
residues of L- functions, in order to detect the image of any chosen functorial 
lift, here I perform a full comparison of two trace formulas; thus, the spec- 
tral content is essentially dictated by the L-groups of the pertinant spherical 
varieties [SV]. On the other hand, many other features of the "beyond en- 
doscopy" project are present. Li particular, L-functions are inserted via 
nonstandard (not compactly supported) test functions; this is essential in 
view of the fact that, say, the Whittaker period and the torus period cor- 
respond to different L-functions; thus, a comparison of the corresponding 
RTFs using standard test functions would be impossible. 

Moreover, the comparison itself is nonstandard: Unlike the paradigm of 
endoscopy, there is no matching of orbits such that the corresponding orbital 
integrals be preserved by the matching of functions; instead, matching is ac- 
complished via a certain integral transform on the set of orbital integrals. 
While the existence of such a transform is more or less predicted by spectral 
matching, and can in principle be calculated whenever one has enough lo- 
cal information about (generalized) characters, it is important that for the 
example at hand we are able to give an explicit formula for it, in terms of 
Fourier transforms and birational maps. This is extremely important for 
the global story: since the comparison does not preserve orbital integrals, 
one will need to prove some kind of Poisson summation formula in order 
to obtain an identity between matching trace formulas; clearly, a Poisson 
summation formula for an arbitrary integral transform is no trivial thing - 
it might prove to be a reformulation of the functional equation of some dif- 
ficult L-function. In my understanding, noone yet has a conceptual reason 
why such a Poisson summation formula should be provable for the integral 
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transforms that will appear in the "beyond endoscopy" project; thus, under- 
standing instances where the transforms between spaces of orbital integrals 
are tractable is an important task. 

1.2. Now I summarize the contents of the present paper. Throughout, G 
denotes the algebraic group PGL2 over a local field F, or the F-points of G. 
The goal is to compare the space of orbital integrals for the trace formula 
corresponding to the quotient T\G/T, where T is a split or nonsplit torus, 
and the space of orbital integrals for the Kuznetsov trace formula - this is 
the trace formula for the quotient {N , 'il})\G / {N , ip) , where is a unipotent 
subgroup and a nontrivial character of the F-points of A^. 

As explained before, such a comparison should not be possible for reasons 
related to different special values of L-functions appearing in global periods. 
Therefore, we need to modify the space of test functions - the standard 
choice is to take Schwartz functions on G, but now our test functions for the 
Kuznetsov trace formula will have nontrivial asymptotics at infinity. The 
best way to describe this is to think of the Kuznetsov orbital integrals not as 
distributions on G, but as G-invariant hermitian forms on S{N\G, ip). Then 
one should replace the standard Schwartz space S{N\G, ip) by sections which 
have a certain prescribed behavior at "infinity" , where "infinity" means the 
partial compactification of A^\G by P^. I describe these nonstandard sections 
in §4.5. 

The affine quotient A^\G // N is isomorphic to (one-dimensional affine 
space), and so is the quotient T\G // T. We will denote both by B, the 
"base" of our quotient stacks. These quotients rougly parametrize orbits, 
and with suitable conventions that are explained in sections 2, 3 and 4 we 
understand the orbital orbital integrals as densely defined functions on B. 
Here "densely" means that we only consider regular orbital integrals, where 
the stabilizers are trivial. Thus, we end up with two spaces of densely defined 
functions on B, the space S{Z) (from orbital integrals for T\G/T equipped 
with standard test functions) and the space 5(W) (from orbital integrals for 
the Kuznetsov quotient with nonstandard test functions). 

Clearly (for anyone who has some experience with those trace formulas), 
these spaces of functions are not even closely related to each other as spaces 
of functions, that is: there is no orbit-by-orbit matching of the two trace 
formulas. However, the first main result (Theorem 5.1.1) is that there is an 
explicit integral transform which takes one to the other. To state it, let J-' 
denote usual Fourier transform in one variable (with respect to characters 
and measures that are described in the text), let rj be the character oi 
corresponding to the splitting field of T, and let l be the following operator 
on functions on B: 




Define the operator: 
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Theorem ("Matching" 5.1.1). The operator \ • \Q is an isomorphism: 

The second main result, for F nonarchimedean and T unramified over 
Qp or Fp((t)) is a fundamental lemma for elements of the Hecke algebra. 
Here we need to specify (§5.3) "basic vectors" f^, /{\; for the spaces S{Z), 
iS(W), which are obtained by the orbital integrals of certain K := G{o)- 
invariant functions "upstairs". For the torus trace formula this will be the 
standard unramified test function, but for the Kuznetsov formula it has 
to be nonstandard, and tailored in order to produce the correct L-value 
L(7r, ^)L(7r® ry, |) on the spectral side of the trace formula. 

Acting by an element h of the spherical Hecke algebra l-i{G,K) on those 
functions upstairs, we denote their orbital integrals by /i*/^ £ S{Z), h*fy^ e 
5(W). The fundamental lemma states that the above integral transform 
carries one to the other: 

Theorem ("Fundamental Lemma" 5.4.1). For any h e T-L{G,K) the opera- 
tor \ • \G carries to h* /-^ . 

1.3. The results of this paper will be used in the sequel [Saka] in order to 
reprove the theorem of Waldspurger [Wal85] on the Euler factorization of 
toric periods. This global application is far from a straightforward appli- 
cation of the local results; the first difficulty has to do with the fact that 
we do not have an orbit-by-orbit matching of trace formulas, and hence the 
matching of global trace formulas has to be proven by a quite nontrivial 
application of the Poisson summation formula. Other difficulties have to do 
with the fact that globally there are conconvergent Euler products, and we 
need to interpret them by analytic continuation; that is why in section 6 we 
introduce variations of our spaces by a complex parameter s e C 

1.4. While I am optimistic about the possibility of generalizing such non- 
standard comparisons to higher rank (and hence proving new period rela- 
tions that generalize the results of Waldspurger), I should add a word of 
caution: The relations that we get here can be seen as reflections at the 
level of orbital integrals to well-known results "upstairs" : on one hand, the 
proof of Waldspurger's results by Jacquet [Jac86] relating orbital integrals 
for T\G/T to orbital integrals for the same quotient with a split torus; and 
on the other, the method of Hecke for calculating split torus periods via 
Fourier coefficients. I explain these relations in the proof of the fundamen- 
tal lemma 5.4.1. 

The point if the present paper is that while the work of Jacquet and Hecke 
does not generalize to all other periods one is interested in, the relations 
between orbital integrals might generalize. Of course, we will not be able 
to tell which is the case before studying many more examples and trying to 
find a pattern for nonstandard comparisons. 
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1.6. Notation. Notation is mostly local, redefined in every section. For 
convenience of the reader, we give an overview of the symbols that are most 
frequently used (and will be defined in the text, if nonstandard): 

F is a local, locally compact field, E a quadratic etale extension of 
F. The quadratic character of associated to E is denoted by 
V = Ve/f- If is nonarchimedean, we denote by o its ring of integers, 
by TO a uniformizer and by q the order of its residue field. 

We feel free to use the same symbol Y to denote the variety Y and 
its points over F, whenever this causes no confusion. For example, 
"functions on Y" means functions on the F-points of Y. When there 
is ambiguity, we will be denoting the latter by Y{F). 

We fix a measure dx on F as explained in §2.3, and a unitary complex 
character ip oi F with respect to which dx is self-dual. 

For p-adic groups, the usual notion of "smooth" vectors and represen- 
tations typically gives rise to inductive limits of Frechet spaces. To 
achieve uniformity with the archimedean case, we describe in appen- 
dix A a notion of "almost smooth" vectors which gives rise to Frechet 
space representations. For simplicity, we call these vectors "smooth" 
throughout the rest of the text and treat the archimedean and nonar- 
chimedean cases together whenever possible, but the reader may 
ignore this and focus on smooth vectors in the traditional sense, re- 
placing the Frechet spaces that we consider with their corresponding 
limits of Frechet spaces of their smooth vectors. 

The notion of Schwartz functions on an open semialgebraic set of a real 
or p-adic manifold is defined in appendix A. When "Schwartz func- 
tion" appears without specifying on which set, we mean Schwartz 
function on F. 

For spaces of smooth functions or sections of line bundles, we use 
the word "stalk" as in §B.4 of the appendix, that is: an element 
of the stalk over a closed set is defined modulo Schwartz func- 
tions /sections on its complement - not modulo compactly supported 
functions/sections on its complement. In particular, the germ of a 
smooth function at a point is completely determined by its deriva- 
tives at that point. 

The symbols W are reserved throughout the text for certain 

quotient stacks related, respectively, to the "baby case" of section 2, 
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the torus quotient of section 3 or the Kuznetsov quotient of section 
4. Other than that, we define and redefine symbols locally, for in- 
stance the letter X usually denotes some homogeneous space, which 
is changing through the text. 

B denotes the "base" of our quotient stacks, i.e. the associated GIT 
quotient. In fact, throughout our examples we have an isomorphism: 
B ^ Ga, which in some cases is completely canonical and in others is 
obtained by some choices which we fix (cf. the remarks after Propo- 
sition 3.1.1). For each quotient space that we are considering, the 
"base" B has a regular set B^^^ (different in each case). We will be 
using this notation when it is clear which quotient space we are re- 
ferring to, and the notation S^^, -B^^, etc. when we want to indicate 
the quotient space. 

M denotes the space of Schwartz measures on the points of a real 
or p-adic variety, as well as on quotient stacks (defined as spaces of 
coinvariants) . For the notions of "Schwartz" (measures or functions) 
in the archimedean case, we point the reader to [AG08]. We explain 
the natural extension of this to spaces of "almost smooth" functions 
on p-adic varieties in appendix A. The reader will not miss any es- 
sential point, though, by thinking instead of compactly supported 
functions (the only mathematical problem being that those are not 
preserved by Fourier transforms, in the real case; also, notationally 
they are clumsier because they do not form Frechet spaces). 

>S denotes the space of Schwartz functions on the points of a real or 
p-adic variety, and also the space of functions on B^^^ obtained by 
orbital integrals of the test functions "upstairs" . 

O, is used to denote "regular" orbital integrals, while O, is used to 
denote invariant distributions supported over the irregular points of 
the base. 

2. A BABY CASE. 

2.1. Before we work with non-commutative groups, we discuss the baby 
case of the relative trace formula for the variety X := of the group 
G := T : = Gm, in order to examine certain integral transforms which will 
be useful in the sequel. We will also discuss a non-split form of the quotient 
X X X/G, which although not under the general formalism of the relative 
trace formula, will provide us with some necessary integral transforms. 

2.2. The split case. We let V denote an 1-dimensional vector space over 
and V* its dual. In some of the calculations below, we will be identifying 

V and V* with F under the pairing (x, y) = xy. We let G = T be the group 
Gm acting diagonally onV x V* . In what follows, we will use the symbols G 
and T interchangeably, choosing in each case the one that is most relevant 
for the applications of the baby case to later chapters. 
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The stack-theoretic quotient V x V*/Grn will be denoted by X; its "dual" 
quotient V* x V/Gm will be denoted by X* . 

The pairing between V and V* induces a canonical identification of the 
categorical quotient of affine spaces (the "bases" ) : 

B := V X V* // T ^ Ga <^ V* X V // T. (2.1) 

We let B^^^, "the regular part of the base", denote the complement of 
zero. Notice that for every ^ e C'^s the fiber is a single orbit of T (both as 
a variety and in the sense of F-points). 

2.3. Tamagawa measures. If instead of F we were talking about a global 
field k, we would be fixing the measure on its ring of adeles which comes 
from a globally defined differential form on Res^/QGa and the usual measure 
on Aq. We factorize this in the standard way locally [Tat67], namely: 

If F = R, the usual Lebesgue measure, if F = C the double of the usual 
Lebesgue measure and if F is nonarchimedean the Haar measure under 
which the ring of integers has measure equal to the inverse square root of 
the discriminant (hence, ^ 1). 

2.4. Measures and coinvariants. We let S{V x V*) denote the Frechet 
space of Schwartz functions on V x V* . Notice that the usual notion of 
"Schwartz space" in the nonarchimedean case does not correspond to a 
Frechet space but to a limit of Frechet spaces. We explain in the appendix 
A how to obtain a Frechet space completion thereof, consisting of functions 
which have the same decay at infinity as in the archimedean case (faster 
than the absolute value of any polynomial) and are almost smooth instead of 
smooth. For practical purposes, the difference between the two approaches 
is unimportant, and the reader can keep the traditional Schwartz space in 
their mind. The introduction of a Frechet space just creates the convenience 
of treating the archimedean and nonarchimedean cases simultaneously. As 
explained in the introduction, we will be just using the word "smooth" for 
what should be "almost smooth"; also, any statement involving derivatives 
(other than the zeroth) should be considered as void in the nonarchimedean 
case. 

We denote by M(y x V*) the corresponding Frechet space of Schwartz 
measures onV x V* (i.e. products of a Schwartz function with additive Haar 
measure). A choice of Haar measure on y x V* defines an isomorphism: 
S{V X V*) ^ Ai(y X V*), but we will not need to fix such an isomorphism 
except as a convenience for certain calculations. 

We define the Schwartz space of measures on X to be: 

M{X) := M{V xV'')g, (2.2) 

the coinvariant space Miy x V*)g- By definition, the G-coinvariant space of 
a Frechet representation W is the quotient by the closed subspace generated 
by vectors of the form v — g ■ v , v e g e G , oi equivalently the universal 
quotient: W Wg, with trivial G-action on the right, through which every 
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continuous G-invariant functional factors. In particular, it is naturally a 
nuclear Frechet space. The space J-{X) of G-invariant, tempered generalized 
functions on V x V* is, tautologically, the dual of M{X). 
The following is standard: 

2.4.1. Lemma. is the weak-* closure of the space spanned by those 

invariant generalized functions which are each supported on a fiber of the 
map: X ^ B. 

We will see a strengthening of it in Lemma 2.5.2. 

2.5. Orbital integrals. For ^ e B^*^^, $ e S{V x V*) and a Haar measure 
dg on G we define the orbital integral: 



Here f is any lift oi^ioV xV* . 

We define S{X) to be the space of functions on B^'^^ of the form ^ i-^ 
0^{^), for $ e S{V x V*). Throughout the text, when we talk about "a 
lift of an element / e S{X) lo S{V x y*)" we will implicitly mean a pair 
consisting of an element $ e 5(y x V*) and a Haar measure on G, so that 
/ is obtained by the orbital integrals of ^. Our first goal is to define (and 
normalize) a linear map: M{X) S{X). To do this, we start with the 
following integration formula: 

2.5.1. Lemma. For any ^ e S{V x V*) with image f e S{X), and Haar 
measures onVx V* and G, we have: 



where d^ is an additive Haar measure on B = F. If we take on V x V* 
the Haar measure corresponding to the differential form dv a dv* and the 
standard Haar measure on F, where the coordinates v and v* are defined 
using a dual basis, dg is the multiplicative Haar measure \a\^^da on F^ , 
then d^ is the standard Haar measure on F (^2.3). 

If we now fix the measure on B to be the standard measure on F discussed 
in §2.3, we get a map: 



as follows: a choice of compatible measures on V x V* and G gives an 
isomorphism: 




(2.3) 




(2.4) 



M{X) ^S{X) 



(2.5) 



M{V X F*) ^S{V X V*) 



and a map: 



S{V X V*)^S{X) 
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and it is easy to see that the composition of the two depends only on the 
chosen measure on B. For the purpose of calculations later in the chapter 
we will fix the Haar measures on y x V* and G described in Lemma 2.5.1.^ 
The following strengthening of Lemma 2.4.1 will be a corollary of Propo- 
sition 2.5.4. 

2.5.2. Lemma. The junctionals O^, ^ e B^°^ span a weak-* dense subspace 
ofT{X). 

This implies that the map (2.5) is an isomorphism of vector spaces. 
Therefore, we will not be distinguishing from now on between A4[X) and 
S{X), and we will endow S{X) with the Frechet topology induced from this 
identification. 

In appendix B we introduce a notion of "Schwartz cosheaves" . We point 
the reader there for definitions of restriction, stalks and other notions. By 
Corollary B.5.2, S{X) is the space of global sections of a flabby (i.e. ex- 
tension maps are injective - in fact, closed embeddings) Schwartz cosheaf 
on B, which for simplicity we will also be referring to by the symbol S{X) 
when there is no confusion. Via the regular orbital integrals, this cosheaf is 
identified with a cosheaf of functions on B'^^^; our purpose is to describe this 
cosheaf. 

2.5.3. Lemma. The restriction of the cosheaf S{X) to B'^^^ is equal to the 
cosheaf S{B^^^) (Schwartz functions in the usual sense). 

Proof. Over B^^^ we have a G-isomorphism of the variety V x V* with 
^'■<=s X G, and therefore X'^^^ := X B'"^ is isomorphic to B^"^.'^ □ 

Now we focus our attention on the neighborhood of 0: 

2.5.4. Proposition. For ^ e S{V x V*) we have, for ^ e B^'^^ in a neigh- 
borhood of 0.' 

O^m = -Ci{0-\n\i\ + C2{i), (2.6) 
with Ci,C2 (almost) smooth functions (which can be arbitrary). 
Moreover, the distributions: 

Oo(^) := Ci(0) (2.7) 

and 

du{^) := C2(0) (2.8) 

are a basis for the space of functionals on the fiber of S{X) over e B, and 
we have: 

Oo($) = Vol(r(F)o)$(0), (2.9) 

^Evon fixing a measure on B locally is not important, since globally we always have 
canonical choices of measures (Tamagawa measures); nonetheless it will be helpful for 
calculations to fix the local maps (2.5). 

^There is clearly some work to be done to establish that isomorphisms of stacks give rise 
to isomorphisms of their Schwartz spaces, but in each of the cases that we are considering 
in this paper this is easy to see explicitly. 
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where Vol(T(F)o) is the volume of the maximal compact subgroup ofT{F) 
described below, and: 



o„($) = lim c(^L=o>s) + C(^L=o,-s; 



d 
ds 



.<(<J>|,.0'^) + <(^Uo'«))' (2-10) 

where is the Tate integral of a function of one variable against unramified 
characters. 



Remark. If we set /(^) = 0^($) then the distributions Oq.,Ou have been 
defined in such a way that they depend only on / e S{X) and not on $ 
and the choice of Haar measure on G, i.e. if we modify $ and the Haar 
measure simultaneously so that the orbital integrals of $ continue to give /, 
we get the same values of Oq{^), 0„(<I>). It is therefore meaningful to write: 
Oo(/),0„(/). 

The volume mentioned in the lemma is obtained as follows. Notice that 
the absolute value gives a canonical short exact sequence: 

1 ^ r(F)o - T{F) ^ Hom(;f*(T)ir, jF^ |) ^ 1, (2.11) 

where T{F)q denotes the maximal compact subgroup of T(F), X*(T)f ^ Z 
is the F-character group of T, and | c denotes the group of absolute 
values of F^ . The group 'Rom{X(T)F, \F^ |) is canonically, up to inversion, 
a subgroup of M.^ (all of M.^ in the archimedean case, the group in the 
nonarchimedean case). We endow it with a Haar measure d\t\ that is on 
average equal to the standard multiplicative measure t~^dt on M.^. Hence, in 
the nonarchimedean case with residual degree q, dt{{l}) = \nq. For a Haar 
measure n on T, the disintegration of ^ with respect to the map (2.11) is 
a Haar measure on T{F)^, and we let: 

Vol(T(F)o) = ^(r(^)o). 

In particular, in the nonarchimedean case, this is (Inq)^^ times ij.(T{F)q). 

Proof. It is easy to see that all functions of the form C2 — ci In |^| can be 
obtained as orbital integrals in a neighborhood of zero, with q = Cj(0) as 
claimed. It is then easy to see that the invariant distributions on the fiber 
of S{V X V*) over the preimage of are given by (2.9) and (2.10). Thus, 
by Proposition B.4.1, the orbital integrals of all elements of S(y x V*) are 
of the form C2(^) — Ci(^) In |^| with d (almost) smooth functions. 

This proves the lemma, and also Lemma 2.5.2. □ 

2.6. Fourier transform. We choose a character ijj : F ^ to identify 
the space V* x V with the Pontryagin dual ofVxV*; we choose it in such a 
way that the measure 2.3 on F is self-dual with respect to Fourier transform. 
Notice that, when working with a global field, adele class characters can be 
factorized as products of such characters. 
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In this paper "Fourier transform" stands for the usual, schoolbook Fourier 
transform without any modifications to preserve equivariance, which in one 
variable v e V reads: f{v*) = f{v)ilj~^{{v,v*))dv. It will be denoted 
both by ' and also by the letter T. 

Hence we have: 

^ix,y) = ^>(-x,-y). 
Since Fourier transform in one variable satisfies: 

T{f{a.)){y) = ^T{f) 



it is clear that Fourier transform on V x is equivariant with respect to 
the action oi G on V x V* and on its dual, and therefore descends to an 
isomorphism: 

S{X)^S{X*). (2.12) 

It is therefore natural to ask how it transforms orbital integrals, or in other 
words: For each $ e S(y x V*), express the function B^^'^ 9 ^ t-^ 0^{^) in 
terms of the function ^ 0^(<I>). 

2.7. The integral transform Q. 

2.7.1. Definition. We let Q denote the transform which maps / e S{X) to 
the Fourier transform of the (tempered) function y 'J^f ' that is: 

^ = 7-0 to J-, (2.13) 

where ,(/) = igl / (i) . 

Of course, in the split case that we are currently discussing we have rj = 1. 
The following lemma shows, in particular, that the function y ^ 'J^f 
is in L'^{B) and hence its Fourier transform makes sense as a function. 

2.7.2. Lemma. The Fourier transform of any f e S{X) has the property 
that: 

lim |x|/(j;) 

exists. 

For the following proof, and later use, we normalize the action of 
on functions on F in such a way that it is unitary (with respect to the 
L^(F)-inner product): 

{a-f){x) = \a\-2f{ax). (2.14) 
Hence, Fourier transform is anti-equivariant with respect to this action. 

Proof. It is easy to see that the function / : x 1-^ ln\x\ becomes smooth 
by application of the operator (Id — |a|~2 «.), for all a e F^ . Therefore, 
its Fourier transform (considered as a tempered generalized function) will 
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become rapidly decaying by application of the operator (Id— |a| 2 a ^•). 
Hence: 

l(x) = 7^ + hi(x) 
\x\ 

in a neighborhood of infinity, for some constant c and some Schwartz function 
hi{x). 

Thus, the Fourier transform of an element of S{X) will be of the form: 

h{x) = h2{x) * l{x) + h^{x) 

in a neighborhood of infinity, where hi are Schwartz functions and * de- 
notes convolution. It is easy to see that for such a function the limit: 
lim|2,|_^co exists. □ 

Hence, for / e S{X) its Fourier transform / belongs to the space of 
continuous functions h on B with the property that lim|j.|^co exists. 
It is clear that i is an involution on this space. The proof of the next 
Proposition will show that it preserves the image of S{X): 

2.7.3. Proposition. Let $ e S{V x V*) and let /(^) = 0^{^). Then: 

0^{^) = g{m). (2.15) 

Proof. We denote by the partial Fourier transforms with respect to 

the first or second argument. We can treat / as a tempered distribution 
on B; let /i be a Schwartz function on B, then according to the integration 
formula we have: 



^^f{Ohmi = \^\^Hx,y)h{xy)d 



'xdy 



= ^^^^{x,y)h {^\y\ ^dxdy = ^{x,y)g{h){xy)dxdy = 

= f o^{^)'m{Od^. 

JB 

It is easy to see that all the integrals above are absolutely convergent. 
Now, Q = J-" o i o J^, and the operations J- and i preserve inner products, 
therefore: 

f f{omdc= f gummmc- 

JB JB 
Hence, 0^{^ = ^(/)(0- □ 

It now follows that gf not only is a function, but it belongs to S{X). 
Since Fourier transform is a topological automorphism oi S(y x V*), it 
follows that ^ is a topological automorphism of S{X), identified with the 
space of coinvariants. It also follows that the image of S{X) under Fourier 
transform is t-stable: 
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2.7.4. Corollary. The Fourier transform of S{X) is the space of those (al- 
most) smooth functions on B which in a neighborhood of infinity are equal 
to \x\^^h (^), for some h e S{B). Moreover, Fourier transform descends to 
a topological isomorphism between S{X)/S{B) and the stall^ of functions of 
the form: 

at 00 (with the obvious topology, given by the derivatives of h at 0). 

Proof. It is clear that we have a short exact sequence: 

^ S{B) -> T (cS(A')) -> y ^ 0, 

arising as the Fourier transform of the sequence: 

^ S{B) S{X) S{X)IS{B) 0, 

where (S(S) is endowed with its usual topology, T is endowed with the 

topology of 5(<Y) and V is defined by this short exact sequence. Moreover, 
the first arrow is a closed embedding, and all elements of T [Si^Xy] coincide 
with elements of SiJS) on any compact subset of B. 

Since t is a topological automorphism of W := J-{S{X)), this implies 
that W consists precisely of functions as in the statement of the corollary. 
Such functions are sections of a Schwartz cosheaf over ;B = in an obvious 
way, and i induces an isomorphism from the stalk at zero to the stalk at 
infinity - the latter being equal to the quotient V. From this it follows that 
the topology on V is given by the derivatives of /i at (where h appears in 
the expansion of a given element at oo as in the statement). □ 

2.8. Mellin transform. Let us now view B ^ Ga as a vector space, and 
describe the integral operator Q in terms of Mellin transforms with respect 
to the action of on Gq. We normalize the action of -F^ on L'^{B) as in 
(2.14). 

By the asymptotic behavior of Lemma 2.7.2, any / e S{X) satisfies the 
Mellin inversion formula: 

/(e) = f _/(x)x(e)ier^^^x (2.16) 

J|.|«-Fx 

for every n < — ^. Here f{x) denotes the Mellin transform (not to be 
confused with the Fourier transform /): 

/(X)= \ \i\^f{0x'\0d-'i- (2.17) 

We do not explicate the dual measures of the formulas above and below, 
because we will only be interested in gamma factors, which do not depend 



Recall that the notion of "stalk" used for smooth functions is the one of appendix B; 
in particular, the germ of a smooth function at a point is determined by its derivatives. 
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on the measures. For this reason, we ignore the fact that our normahzation 
of multiphcative measures is different from the one of Tate's thesis. 
We claim: 

2.8.1. Lemma. We have G{f){x) = 7(X) where ^{x,s,ij)) is 

the gamma factor of x o,t s (cf. below). 

By the Mehin inversion formula (2.16), this completely characterizes the 
operator Q. 

Proof. By continuity of ^, it is enough to prove it for / in a dense subspace 
of S{X), so let us assume that f{() = 0^{^) with ^{x,y) = $i(x)$2(y)- 
Then by the integration formula we can write: 

fix) = ^i{x)^2iy)x'^{xy)\xy\^d''xd''y = 

C($i,x^\^)-C(<f2,x-',^), 

where C{^i,Xis) = ^p,y ^i{x)x{x)\x\^d^ x denotes the Tate integral of 
[Tat67]. 

Similarly, G{f) = C{^i:X~^^ ^)'C{^2,X^^j find by the functional equa- 
tion for Tate integrals we have, by definition: 

7(x, s, ij)C{^i, x, s) = Ci^i, 1 - s)- 
This implies the claim of the lemma. □ 

2.9. The non-split case. We discuss now the non-split version of the pre- 
vious example, where V x V* has been replaced by the space whose F-points 
are equal to the elements of a quadratic field extension E, under the action 
of the group of elements of norm 1. In other words, we take: 

X = ResE/pGa, 

the one-dimensional torus T over k defined by the short exact sequence: 

1 ^ T ^ ReSE/p'^m — ^ 1, 

and we will be interested in the quotient stack: 

X = X/T. 

The quadratic character of associated to the extension E will be denoted 
by Ve/f or simply r]. 

Again we have a canonical isomorphism of categorical quotients: B := 
X II T — > Qa given by the norm map. 

The first thing to notice here is that the quotient stack has "points" corre- 
sponding to nontrivial torsors of T and which are, therefore, not accounted 
by F-points of X\ this is already evident by the fact that the map: X ^ B 
is not surjective at the level of F-points. We therefore propose the following 
two definitions of M.{^X\ which can be seen to be equivalent (the first one 
was suggested to me by Joseph Bernstein): 
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(1) We let T GL2 be an embedding, and let M(X) denote the 
GL2(F)-coinvariants oi M {{X x'^ GL2)(F)) (Schwartz measures ) . 

(2) We let be the direct sum, over all isomorphism classes a of 
T-torsors, of the coinvariant spaces: ^A{X°'{F))J^a^py 

Here for a T-torsor i?" in the isomorphism class denoted by a 
we let T" = Aut(i?")^ and X" = X R°'. (In terms of Galois 
cohomology, a can be regarded as denoting an element of H^{F,T), 
T" is defined by its image in H^{F, Aut(r)) and X'^ by its image in 
H^{F,Aut{X)).) Of course, in this case we have ^ T for all a, 
but these constructions make sense in a much more general setting 
- and explain inner forms appearing in the relative trace formula. 

Notice that X°' has F-points if and only if i?" admits a T-equivariant 
morphism into X. 

Although the first definition is more natural and geometric, the second 
one is more suitable for spectral expansions, and we will be working with 
that. 

2.10. Integration formula, Orbital integrals. We endow X{F) = E 
with a Haar measure, and then the exact sequence: 

together with the multiplicative measure on F^ (where dx is the 

standard additive measure on F discussed in 2.3), endow T{F) with a Haar 
measure which, by definition, satisfies the integration formula: 

f $(e)(i^e = f 05($)d^^, 

JE JF 

where 0^{^) is the orbital integral: 

0^{<^) = I ^{i-t)dt (here i: a lift of ^ to E). (2.18) 

JT{F) 

Since, by definition, the absolute value of an element of E is equal to the 
absolute value of its norm in F, we also have: 

f $(e)de = f 0^{^)d^. (2.19) 

JE JF 
The following is immediate: 

2.10.1. Lemma. There are compatible choices of invariant measures on 
Uq,X°(F) such that for any ^ e 5(uqX°) with image f e S{X) we have: 

f ^x)dx = f fiOd^. (2.20) 

JuaX°'{F) JB 

Notice that, although X°' is T = T"-isomorphic to X, the measures are 
not preserved by such a (non-canonical) isomorphism. 
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We define S{X) as the cosheaf over B of functions on B'^'''^ obtained as 
orbital integrals of elements of 5(uqX°). Notice that this includes the 
summands parametrized by all classes of T-torsors. Again, the standard 
measure on B = F gives rise to a linear map: A4{X) — > S{X), which can be 
seen (and will follow from the sequel) to be an isomorphism. 

For the rest of this section we denote by X" only the copy corresponding 
to the nontrivial torsor, and by X the copy corresponding to the trivial one. 
The "origins" of X and X"' (i.e. their unique F-points over ,^ = 0) will be 
denoted by Ox and Ox«- Here T{F) = T"{F) is compact, therefore the 
asymptotic behavior of orbital integrals is easy to determine: 

2.10.2. Proposition. The restriction of S{X) to B'''^ is equal to SiB"""^). 
In a neighborhood of zero, the sections of S{X) are precisely those functions 
of the form: 

Ci(e) + C2(0r?(6, (2.21) 
with Ci, C2 (almost) smooth functions in one variable. Moreover, the values 
Ci(0), C2(0) are a basis for functionals on the fiber of S{X) over ^ = 0, and 
we have Ci(0) = do,i{^), C2(0) = Oo,ko(<&), where: 

Oo,i{^) = ^Yol{T{F)) mOx) + ^Ox^)) , (2.22) 

Oo,«o(^) = ^Vol(r(F))(<D(Ox)-<J>(Oxc«)). (2.23) 

We explain the index kq: the Langlands dual group of T is the semi- 
direct product of with Gal(F/F), and the Gal(F/F)-invariants of 
consist of two elements 1, kq- I^i the second (global) part of the paper we will 
recall that these elements parametrize characters on H^{F,T), and hence 
the distribution Oq.k (i^ = Ij'^o) is a "«:-twisted orbital integral" over a 
stable orbit. 

Proof. It is very easy to see that if ^ is supported on X{F) then, close to 
zero, 0^($) is equal to if ^ is not a norm from E and equal to a smooth 
function with value Vol(T(F)) • $(0x) at zero if ,^ is a norm; similarly for 
the case that ^ is supported on X"(F), but with ^ not a norm. The result 
follows. □ 

2.11. Fourier transform. We define Fourier transform on by identifying 
it with its Pontryagin dual via the pairing (x,y) ^ 'ip{tr{xy)), where tp is 
as before and y denotes the Galois conjugate of y. The chosen measure on 
E is self-dual with respect to Fourier transform. Since we will be interested 
only in characters XE which are base change of characters of , i.e. 

Xe = X ° equivalently, xe = Xe, the functional equation of Tate 

integrals does not change under this alternative definition of duality, i.e.: 

l[XE,s,i>E)(:E{^,XE,s) =Ci^(i,Xs^l-s) (2-24) 

for such characters xe- The additive character ipE will be taken to be the 
composition of the character -i/; used previously on F with the trace map. 
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The correct way to define Fourier transform on X°'(F) = E°' is to notice 
that the hermitian map: (x,y) ^ tr(xy) extends natm'ally to E": if we 
choose any isomorphism i : E ^ E°' which maps 1 e E to the element 
a e E" then we have: 

ti^LX - Ty) := tr{Np {a)xy), 

and this definition clearly does not depend on i. Then we have on E'^, as 
we had on E: 

^(y) := <l>{x)'ilj-^{ti{x-y))dx, (2.25) 
for the Haar measure defined previously, and this is self-dual, i.e.: 

2.11.1. Lemma. For e C^{E'^), 

^(x) = ^"{-x). (2.26) 

Proof. In what follows, it is important to distinguish between absolute val- 
ues in F and in E, therefore we will be distinguishing them by an index. 
Choosing an isomorphism (j) : E ^ with 1 ^ e and Np{e) = a, and 
denoting the pullback of <l>° under this isomorphism by , we have: 

= ^ (^'^{4)x)ij-^{axy)\a\Fdx = \a\F^^{ay) (2.27) 

and, similarly, 

<^*$^(2;) = |a|F(/.*^^(ax) = |o||^ (7-($°(a • •))) {ax) = 

\a\E V a / 

□ 

For / e S{X) we now define the transform Q as in (2.13), except that now 
rj is nontrivial. 
We claim: 

2.11.2. Proposition. Let f e S{X) with lift ^ e S{X). Then: 

Od^) = g{f){0- (2.28) 

Proof. Before we discuss the proof, let us discuss Tate integrals on E": they 
will be defined as: 

CEi'^^,XoN^,s)= f <^''{x)x{N^x)\xr'dx, 

JE°' 

where \x\ denotes the absolute value, extended to E"' via the norm map. 
The Tate integral is defined only for characters of the form x ° ^^^^ 
case. If, now, <^ is a function supported on the union of E and -E" (with 
corresponding restrictions denoted by and <I>°) we define: 

Ce(^, X o N^, s) = Ce($°, X o iV#, s) + Ci^(^", X o iV#, s). 



18 



YIANNIS SAKELLARIDIS 



It can be seen that, with these definitions, the local functional equation 
(2.24) still holds. Notice, moreover, that since XE = X° have: 

liXE, s, i{je) = lix, s, ip) ■ 7(X ® Ve/f, s, ip) (2.29) 

It is now clear, as in the split case, that the Mellin transform of f{(,) = 
0^($), $ e S{X), can be written as: 

f{x)=CE{^,X-'oN^,l), (2.30) 
and similarly if = Og($) we have: 

hix)=CE{^,X-'oN^,\). 

Therefore: 

1 1 - 

Hx) = i{x,^,i^h{x<^VE/F,^,i^)f{x''^)- 

Both h and G{f) satisfy the Mellin inversion formula 2.16, since they 
belong to S{X), therefore it suffices to check that their Mellin transforms 
coincide, which is immediate by the above calculation and an easy calcula- 
tion of the Tate integrals of G{f). 

□ 

3. The torus quotient. 

3.1. From now on G will denote the group PGL2 over F. By T we will be 
denoting a nontrivial torus in G, and E will be the quadratic etale extention 
of F such that T = keic{Np). If T is split we have E = F @ F , and in that 
case we will sometimes be identifying T with some maximal torus inside 
of a chosen Borel subgroup, and will also be denoting it by A. As before, 
r] = rj^ip is the quadratic character associated to E. 
The first main result of this section will be: 

3.1.1. Proposition. Let y denote the stack (Res£;/pGa)/r with the preim- 
age of ^ = —1 e B := {ResE/pGa) // T ^ Ga removed. Let denote y 
with the preiniage 0/ ^ = removed; then the morphism to B defines an 
isomorphism between y^ and \ { — 1,0}. 

3^1) 3^2 denote two distinct copies ofy, the stack Z := T\G/T is iso- 
morphic to the glueing o/3^i,3^2 by the map: 

Among other things, this allows us to identify the GIT quotient X x X //G 
with B = Ga- To preserve consistency of notation, the diagonal copy of X 
in X X X will have image —leB, and the open subset yi will be such that 
it contains the image of the diagonal copy (and hence the map 3^2 ^ S will 
be the one defined in the previous section, while the map yi ^ B will be 
obtained from that by ^ 1-^ — 1 — ^). We let B^^^ = B^^^ be the complement 
of {0,-1} in B. 
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3.2. The open subset in the split case. We consider first the case E = 
F^F, let B^,B^ denote the two Borel subgroups which contain T = A 
and let Zi := A\{B- B+ n B+B-)/A, which is open in Z. 



3.2.1. Lemma. (1) The map:^ 

FeFB(x,,)^(' ^y[l ,:,^)sG (3^1) 

descends to an isomorphism: 

y^Zi. (3.2) 

(2) Let w be an element in the F-points of the non-identity component 
of the normalizer of A, then the automorphism g ^ fixes the 
preimage of Z\ in G and has the property that: 

"'.(x,y)~6fy(l + xy),-^') (3.3) 

modulo the action of A x A. 

Proof. Direct calculation. For the first statement, one easily sees that 
A\(B~B^ n B^B~) is isomorphic to the variety of matrices of the form 
(3.1) with xy 7^ —1, and that, thinking of those matrices this way, the map 
L is A-equivariant. The second statement is immediate. □ 

3.3. Let X = A\G and let w denote the nontrivial G-automorphism of X. 
We have a natural isomorphism of stacks: 

X X X/G 3 (xi,X2) ^ xix^^ e A\G/A, 

and applying the "lu" -automorphism on the second copy of X induces an 
isomorphism of open substacks: 

Z2 — ^ Zi, 

where Z2 = A\{BwB n B-wB-)/A. 

Combined with the isomorphism of Lemma 3.2.1, this proves Proposition 
3.1.1 in the split case. 

3.4. The non-split case. In the above setting, but with E now denoting a 
field extension, the cocycle which takes the nontrivial element a of Gsd{E/F) 
to the inner automorphism of G by it; (viewed also as an automorphism of 
A) defines a form of both PGL2 and A over F. The form of ^ is T = 
keT{Np), while the form of PGL2 could be split or non-split according as 
the cocycle chosen lifts to GL2 or not. (This depends on the representative 
w e N'{A)(F) chosen, more precisely on whether the negative of the quotient 
of its eigenvalues is a norm from E or not.) This shows, in particular, that: 

T\G/T - T\G'/T, (3.4) 



"^For notational clarity, we formulate in terms of _F-points some statements which 
should, strictly speaking, be formulated in terms of schemes. 
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where G = PGL2 and G' is an inner form of G which sphts over E. 

Notice that w preserves the open substacks Zi , Z2 of Z and hence defines 
forms of those. 

At the same time, we have seen that the "w" automorphism on A\G 
corresponds, under the map i of Lemma 3.2.1, to the automorphism: 

r : (x, y) ^ ( y(l + xy), — ^ — ) 

of the subset of {x,y) e k @ k with xy 7^ —1. This is the same as the 
composition of the automorphism: {x,y) ^ iy,x) with the action of (1 + 
xy, i^^y ) e A, and therefore the form of the quotient stack defined by the 
cocycle a >— > r is isomorphic to: 

3^i-(Resf(G,)\(iV#)-i(-l))/r. 

Therefore, even in the non-spht case we have: Zi ~ yi and, similarly, 
Z2 — 3^2) which completes the proof of Proposition 3.1.1. 

3.5. Schwartz functions and orbital integrals. We define A4{Z) to be 
the G-coinvariant space of A4{X x X) (the Frechet space of Schwartz mea- 
sures) in the split case. In the non-split case we must, as before, use one of 
the following equivalent definitions: 

(1) For soniG Giiib6d.d.ing of G into GL^t, we let ^A{Z) be the space of 
GL„(F)-coinvariants of M {{{X x X) x^ GL„)(F)). 

(2) We let Ai{Z) be the direct sum, over all isomorphism classes of T- 
torsors i?", of the coinvariant space: 7W((X° x X°'){F))Qa^p-^, where 
G" = AutaiR" G), X" = r\G". Equivalent^, G" ranges over 
inner forms of G which split over E. 

By the above isomorphisms of stacks, we also have: 

M{z) = {M{yi) e M{y2)) /M{yi n 3^2). (3.5) 

We let S{Z) denote the cosheaf on B of functions on B^^^ which are 
obtained as regular orbital integrals of Schwartz functions on Ua(X" x X"). 

05(f) = f m-g), (3.6) 

JG{F) 

where ^ is a representative for the orbit parametrized by ^. 
The results of section 2 immediately imply: 

3.5.1. Proposition. The restriction of S{Z) to B'^^'^ = Ga \ {0, —1} is equal 
to the cosheaf of Schwartz functions S{B^°^). In neighborhoods of ^ = and 
= —1 they have the behavior of the germs of Propositions 2.5.4, 2.10.2 
around zero. 

The choice of Haar measure on G{F) does not matter for the definition 
of the sheaf S{Z), and again by a "lift of an element of S{Z) to S{X x X)" 
we will implicitly mean an element of S{X x X) together with a choice 
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of Haar measure on G{F). However, we would now like to define a linear 
isomorphism: 

M{Z)^S{Z). (3.7) 

We do this locally on the open cover Zi u Z2 by using the identification of 
Ai{Zi) with A4{yi), together with the identification (3.7) from the previous 
section: M.{yi) ^ 5(3^i), which gives rise to an map to S{Z): 

M{Z,) ^ Mm ^ siy,) ^ S{Z). 

Equivalently, this isomorphism arises from the standard additive measure 
on S = F. Notice that the same integration formula as in the previous 
section (Propositions 2.5.1 and 2.10.1) follows from the local isomorphisms 
of stacks: 

3.5.2. Lemma. There are compatible choices of invariant measures on B 
(additive), G and Uq(X" x X°') such that for any <I> e 5(ua(X" x X"-)) 
with image f e S{Z) we have: 

\ ^xi,X2)dxidx2 = f fiOd^. (3.8) 

3.6. Inner products. In order not to introduce excessive notation, we will 
not reserve any symbols for the irregular distributions on Z which are the 
analogs of Oq, Ou, Oo,1) Oo,ko of §2, with one exception: 

Let a be a class of T-torsors. For ^1,^2 £ 'S{X°'), and an invariant 
measure dx on (where "invariant" means, of course, invariant under 
the pertinent inner form of G on each copy) we define the inner product of 
^>i,^2 as: 



($1,$2) = ^l{x)^2{x)dx, 
JX°' 



i.e. as a bilinear form. Clearly, this extends continuously to S{X" x X"), 
and for an element $ of the latter we will simply write ($). 

Now, given / e S{Z), choose a pair ($, {dga)a) consisting of an element 
$ = 2 e ©Q,5(X" X X") and a collection of Haar measures on the inner 
forms such that / arises as the regular orbital integrals of <I> with respect 
to those measures. Let: 

1, if a corresponds to the trivial torsor, 
(-1)" = I ^ (3.9) 

I —1 otherwise; 

that is, we are identifying H^{F,T) with Z/2 in the nonsplit case. 
Then we define the "inner product" of / as: 

(/) := (FX : 7V#FX)-i • ^(-l)" Vol(r(F)o) , (3.10) 

a 

where we have implicitly chosen a decomposition of dg as an invariant mea- 
sure on T{F) times a measure on T\G'^{F) in order to define both the inner 
product on X°' and the volume of T{F)q according to the recipe of §2.5 (of 
course, in the non-split case T{F)q = T{F) so no recipe is needed). Clearly, 
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the definition does not depend on this choice, so we have a weh-defined func- 
tional on S{Z). The fohowing is easy to see by the results of the previous 
section: 

3.6.1. Lemma. In the split case (/) is equal to the distribution Oo(/) of 
(2.7) when a neighborhood of ^ = —1 of Z is identified with a neighborhood 
of ^ = of X according to Proposition 3.1.1. In the nonsplit case, (/) is 
equal to the distribution Oo,ko(/) '^f (2.22) under the same identification. 

4. The Kuznetsov quotient with nonstandard functions. 

4.1. The Kuznetsov trace formula is the relative trace formula for S{X, C^)<S) 
S{X, jC^^), where X is the quotient of PGL2 by a nontrivial unipotent sub- 
group N and is the complex G-line bundle on X defined by a character 
ip of N{F). Here, however, we will extend it to nonstandard sections of this 
line bundle, that is, sections which are not Schwartz, with prescribed asymp- 
totic behavior at infinity. One can identify X with the quotient by { + 1} 
of two-dimensional affine space, minus the origin, and "infinity" is precisely 
the partial compactification of this space by at "infinity". 

Let us start in a slightly different way: Let G = Aut(P^) and let X denote 
the total space of the line bundle 0(— 2) over P^; it is G-linearizable, i.e. it 
carries an action of G which commutes with the natural action of Gm- We 
denote by X the complement of the zero section - it is homogeneous under 
G, and stabilizers are unipotent subgroups. There is a unique, up to the 
action of GmiF), G'(F)-linear complex line bundle on the F-points of X on 
which the stabilizers of points on X act by a nontrivial unitary character; 
we fix such a line bundle, and denote it by C^. Over this is G-isomorphic 
(non-canonically) to the trivial line bundle. For any subset S X x X 
we will denote by S'^ the open subset of S lying over the open G-orbit on 
P^ X P^. US is stable under the diagonal action of G, then so is 5^. 

4.2. Orbits. Let N be the subgroup of upper triangular unipotent matrices 
in PGL2, the subgroup of lower triangular matrices, both identified with 
the additive group in the usual way, and A the torus of diagonal elements. 
Fix a nontrivial unitary character ^ of F, the same character that we used for 
Fourier transforms in previous sections. We claim that there is a canonical 
map from [X x X)+ to the open subset: 



of N\G/N-. 

Indeed, let (x, y) e {X x X)~^ , then there is a unique isomorphism of the 
triple {G,Gx,Gy) with (PGL2, iV, A^~) such that Gx acts on the fiber of 
by the character ^ of N(F) = Ga{F) (standard isomorphism), and a unique 
isomorphism such that Gy acts on the fiber of £7^ by the character ip^^ of 
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N-{F) = Ga{F). Then ^ ^ J is the unique element of A which conju- 
gates one isomorphism to the other; our convention to distinguish between ^ 
and is that as (x, y) approach the complement of {X x X)^ in X x X, 
goes to infinity. This defines an isomorphism of quotient stacks (varieties): 

{X X X)+/G - Gm. (4.1) 

We embed Gm ^ B := Ga ^ B := F\ and set B'"^ = B'^^ = B {0}. We 
will sometimes be denoting the regular set by B^ . 

4.2.1. Lemma. The map (4-1) extends to a rational map: 

X X X^B, (4.2) 

which is regular away from the complement of (P^ x X) + m X X, that is: 
away from the set of points {p, x) e¥^ x X such that x lies in the fiber over 
p. 

The reader should keep in mind that = corresponds to points on 
(P^ X X)^ , while ^ = CO corresponds to the complement of {X x X)^ in 
X X X . This paradoxical way of parametrizing orbits plays a role when 
discussing Fourier transforms (where the vector space structure imposed on 
B is important). 

There is a certain degree of arbitrariness in choosing the "standard" iden- 
tifications of N, N~ with Ga] therefore, there is nothing special about the 
orbit above ^ = 1. However, this choice should be compared to the choice 
that the "irregular" orbits of Z map to {0, —1} e B in the discussion of sec- 
tion 3; both are essentially choices of a generator of the ring of invariants, 
they are related and should be changed simultaneously. 

4.3. Orbital integrals. In what follows, we try to make explicit the choices 
made in order to think of orbital integrals on the Kuznetsov trace formula 
as functions on B^°^ ^ . The reader may wish to skip straight to (4.6). 

Let $1, ^>2 be smooth sections of C^, resp. C^^, of compact support on X. 
Fix a Haar measure on G = G{F). At a first stage, we define the (regular) 
orbital integrals of $i (x) $2 to be the G- invariant section of |x] on 
{X X X)^ obtained by integrating $1 • $2) that is: 

0(x,y)(^i®^2) = f g-{'^i,'^2){x,y)dg, (4.3) 
Jg 

where g- denotes the right regular representation under the diagonal action 
of G. 

At a second stage, we would like to represent these orbital integrals as 
functions on B^ := B \ {0} = F^ . Let {xo,yo) e {X x X)+, with image 
1 e B, let A denote the unique torus in G which normalizes both Gxq and 
GyQ, identified with Gm according to the image of {xoa,yo) in B {a e A). 
For ^ e Gm corresponding to a e ^, let: 

05(^1® $2) = 0(,„,j,o)(a-$i®$2), (4.4) 
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where a acts on the section O(^xo,yo){^i ® '^'2) by the regular representation 
on the first coordinate; hence, 0^($i ® ^"2) is understood as an element in 
the fiber of over (xo,2/o)- We remark that a- denotes the action of a as 
an element of G\ the natural action of Gm 

on 0(— 2) by dilations does not 
extend to the line bundle C^. When, later, we will replace by the trivial 
line bundle, we will be denoting the action of Gm by dilations by (where 
^ is supposed to be reminiscent of "left action" in terms of the torus acting 
on X ^ N\G), in order to avoid confusion. Notice that the orbit map: 
3 a ^ {x ■ a,y) e {X X X)+ extends to: 

B^{XxX)+. (4.5) 

Finally, we choose an isomorphism of the fiber of [x] over {xq, i/q) 
with C, in order to consider 0^($i (x) ^2) as a complex-valued function on 
, as ^ varies. This last choice of isomorphism only affects the orbital 
integrals by a common scalar multiple, and will be reflected in our choice of 
unramified sections in the fundamental lemma (e.g. we will ask that some 
sections be equal to "1" at (xo,yo); which only makes sense after choosing 
this isomorphism). 

Explicitly, if we identify the stabilizers of xq, i/q with N, such that they 
act on resp. by -0,7/;^^, respectively, and if we trivialize the fiber 
in order to think of $1 (x) $2 as an element of C^{N\G x N^\G, ^ (x) ^~^), 
then: 

Oc($i(x)<I>2) = £'J>i(( ^ ^^g)M9)dg. (4.6) 

Given these choices ~ that is, the embedding (4.5) and the identification 
of the fiber over 1 with C, we can easily see: 

4.3.1. Lemma. (1) The action map: 

B X G ^ {X X X)+ (4.7) 

is an isomorphism. 
(2) The chosen trivialization of the fiber over (xq, yo), the action of B^ x 
G (here B^ is acting as the torus A on the first copy, as before), and 
the above isomorphism give rise to a G-equivariant isomorphism of: 

-1 



C^\x\C, 



{XxX) 



+ 



with the trivial line bundle over B x G. 

4.4. Integration formula. Identifying sections $ e 5 (^C^ S^C^^ 

with sections of the trivial line bundle according to Lemma 4.3.1, we have: 

4.4.1. Lemma. For suitable choices of a G-invariant measure on X = X{F) 
and a Haar measure on G = G{F), we have: 

f ^x,y)d{x,y) = f O^imr'^dC, (4.8) 

J{XxX)+ JB 
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where is our fixed, standard additive measure on B ^ F. 

4.5. Nonstandard sections. We let M{X x X,£^\xi£^-^) (resp. S{X x 
X, CipMC^^)) denote the Schwartz cosheaf over X x X consisting of smooth 
measures (resp. functions) on X x X, valued in jC^pM^.^^ , with the following 
properties: 

• the restriction of the cosheaf to X x X coincides with the standard 
cosheaf of Schwartz measures (resp. functions) valued in £^ |x]>C^^; 

• in a neighborhood ofF^ x X they are finite sums of the form fiFi, 
where: 

(1) the /j's are 0>C^^-valued Schwartz functions on X x X; 

(2) the Fi are scalar- valued measures (resp. functions) on X x X 
which are G- invariant in the second coordinate"", and in the first 
coordinate are annihilated asymptotically by the operator: 

(l - 5-ka)^a) ■ (l - Ve/f^-'^ («)^a) • (4.9) 

Our notation is hiding the details of the asymptotics, and is just replacing 
X by X to remind that these measures are not Schwartz on X; however, 
they cannot be considered as smooth measures on X. 

We explain what it means, for a scalar-valued function or measure on X, 
to be asymptotically annihilated by (4.9). Thinking of Gm as the dilation 
group of the bundle 0(— 2) over P^, we have an L^-isometric action of it on 
functions on X given by: 



^afix) = 5{a)—2f{ax), (4.10) 

where 6{a) is the inverse of the character by which the non-normalized action 
of Gm transforms an invariant measure on X, written suggestively so that 
in an identification of X with X\PGL2 it corresponds to: 



1 ■ 

Similarly, we have an L^-isometric action of Gm, on measures on X given 
by: 

^alJ^{x) = 5{a)'2^{ax), (4.11) 

and of course the map from functions to measures: / ^ fdx is equivariant 
with respect to these actions. 

Hence, "asymptotically annihilated" by (4.9) means that applying the 
operator (4.9) to the given function/measure produces a function/measure 



^This is just one of many equivalent ways of describing our measures, and the reader 
should not get confused trying to figure out the purpose of invariance in the second 
coordinate; the point is that our resulting measures will be of Schwartz type in the second 
coordinate, which is taken care of by the /i's, so we only need the FiS in order to describe 
their asymptotic behavior in the first coordinate. 
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which is supported away from P . Thus, these functions can be identified in 
a neighborhood of with elements of a representation vr of the form: 

0^/(5l) ^7r^/(r?^/^<^l) ^0, (4.12) 

where the sequence is nonsplit if (and only if) r]pip is trivial. Here /(•) 
denotes the principal series representation obtained by normalized induction 
from the character •. However, the isomorphisms with principal series are 
not canonical, and we prefer to think of tt as the space of smooth functions 
on X which are annihilated by (4.9). 

4.6. Coinvariants. We let M.{yV) denote the G-coinvariants oi M.{X x 
X,C^ ^^^)- Here the letter W is reminiscent of a stack, but for us it is 
just formal notation, because I do not know how to make sense of /3^[x]>C^"^ 
as a bundle on the stack. We denote by Ai(W^) the G-coinvariants of those 
measures which are almost supported on {X x X)^ <^ X x X. 

Using the trivializations of Lemma 4.3.1, we have a map from MiVV) to 
smooth measures on B^; as we shall see, this map is injective, so we feel 
free not to distinguish between an element of A4(W) and the corresponding 
measure on . We let 5(W) be the space of functions on B^ which are 
obtained as "regular" orbital integrals (understood as in §4.3), with respect 
to a Haar measure on G, of elements of S{X x X, |x] C^^). According to 
Lemma 4.4.1, the map ji t— > is a linear isomorphism: 

M{W)^S{W). (4.13) 

We would like to understand the spaces A^(>V^), A1(W) as sections over 
B, B oi the G-coinvariants of the push- forward to B of the Schwartz cosheaf 
JVii^X X X, ^C^^), in order to take advantage of the results of appendix 
B. This is not directly possible, as the map (4.2) is rational, not regular. We 
will see, however, in Proposition 4.10.1 that the stalk over the irregular locus 
S of (4.2) does not contribute at all to A^(W); thus, we may indeed view 
7W(yV) as (sections of) the flabby cosheaf of coinvariants of the push-forward 
oiM{{X X X)\S,CiMC-^^)- 

4.7. Limiting behavior at 0. Let X be the quotient stack of section 2, 
that is: X = Res^'/^Ga/T, where T = kevNp. We consider elements of 
M[X) as measures on \ {0} = , as we do with elements of M(W). 
Recall that A4{yV~^) denotes the sections of this cosheaf over {X x X)^ , and 
S(yV^) their images under the operation of orbital integrals. 

4.7.1. Proposition. As spaces of measures on , we have: 

7W(W+) = I • \-^M{X). (4.14) 

The symbol | • denotes multiplication of a measure //(.^) by |^|^^. 
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Proof. Using the isomorphisms of Lemma 4.3.1, the space J^{{X x X)^ , C^,\E\ 
C^^) can be identified with a space of scalar-valued measures on x G 
with the following properties: 

• away from a neighborhood of {0} x G they coincide with Schwartz 
measures; 

• in a neighborhood of {0} x G they are equal to a Schwartz function 
on B X G times a measure ^.{b)dg with dg a Haar measure on G and: 

^(6) - ^{ah) - 7]E/F{a)fi{ab) + 7/s/^(a)/u(a^6) = 0, (4.15) 

for every a e . 

Their G-coinvariants coincide with their push- forwards to B^ , which are 
characterized by the analogous properties (i.e. Schwartz away from and 
same condition on the measure /i). By the explicit description of M{X) in 
Propositions 2.5.4 and 2.10.2, the claim follows. □ 

4.7.2. Corollary. As spaces of functions on B^ , we have: 

S{W^) = I . \S{X). (4.16) 

This follows immediately from the integration formula of Lemma 4.4.1. 
In the next subsection we will identify the limiting behavior of an element of 
SiyV'^) as ^ ^ in terms of invariant distributions supported on the fiber 
over ^ = 0. 

4.8. Explication. We would now like to explicate the "irregular" distribu- 
tions that determine the limiting behavior at zero. 

Let V be defined by the short exact sequence of Frechet spaces: 

o^5(x X x,/:^s/:;i) ^5(x X x,/:^,0/:-i) ^0. 

(Recall that S{X x X,C^ [x]i2^^) denotes the nonstandard sections defined 
in 4.5 and not really sections of the line bundle over X x X.) That is, in the 
language of appendix B, y is the stalk over ¥^ x X oi the Schwartz cosheaf 
whose global sections are S{X x X,C^ ^C'^^). 

Let denote the Frechet space of germs of smooth sections of 
around P^. Since is trivializable over P^, this space is isomorphic (non- 
canonically) to the space of germs of smooth functions around P^. Then we 
have an isomorphism of G x G-representations: 

V ^ (^^(|c=o(pi)vr)(|5(X), (4.17) 

(completed, projective tensor products), where vr is as in (4.12). 

Clearly, the fiber over P^ x X is obtained by evaluation of the element of 
on P^, which gives a map: 

S{X xX.C^m C-^'') - (C"(P\ £^,) (x)c,x(pi) vr) (x) S{X, £^i). (4.18) 

The first tensor product is isomorphic to vr, depending on a trivialization 
of over P^; for simplicity, but to remember that this isomorphism is not 
canonical, we will be denoting it by vr'. Since the elements of vr can be 
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thought of as sections of the trivial line bundle on X annihilated by the 
operator (4.9), elements of vr' should be thought of as similar sections of the 
pullback of under the projection map: X — > P^. We are going to encode 
the G-coinvariants of the fiber in two "irregular" orbital integrals. 

For now we will define those irregular orbital integrals only for elements 
of 5(yV^). Let / e S{W^) and {^,dg) be a pair consisting of an element 
$ e 5((XxX) + ,/:^[x]£-i) andaHaar measure on G such that / is obtained 
by the orbital integrals of $. Under the isomorphisms of Lemma 4.3.1 (see 
also the proof of Proposition 4.7.1), $ can be written as a function on B x G 
of the form: 

ICI (-^i(C, 5)1111^1 + ^2(^,5)) in the split case (?? = 1), 

ICI {hi{C,g) + r]{C)h2{C, 9)) in the non-split case [t] 7^ 1) 

where hi{£^,g) are Schwartz functions on ^ x G. 
In the split case we set: 



O 1 



(/)= f /ii (0,5)^^5, (4.19) 
JG 

if) = f h2{0,g)dg. (4.20) 
JG 



O 1 

In the nonsplit case we set: 

OQ^^i(/) = £/ii (0,5)^5, (4.21) 



O 1 



{f) = j^h2{0,g)dg. (4.22) 

Then it is easy to see: 

4.8.1. Lemma. For f e W'*', there are smooth functions Ci, C2 so that in a 
neighborhood of zero: 

/(O = \i\ In lel + C2[0) in the split case, (4.23) 

/(^) = {Ci{i) + r?(0C2(0) m the non-split case. (4.24) 
Moreover, CiUd) = O 1 (/) and C2(0) = O 1 (/) in the split case, Ci(0) = 

0,o3 ?i,o3 

O i(f) and C2(0) = O i(f) in the nonsplit case. 

Thus, with the isomorphism of Corollary 4.7.2 and the distributions de- 
fined in section 2, we have: 

o,,iU) = Oo{\'\-'f), 



i(/) = o„(|.rv) 

"■,,0 2 



in the split case, and: 



o a(/) = Oo,i(|.|-V), 

^o,,si^f^ = Oo,^oi\'\-'f) 
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in the nonsplit case. 

4.9. Inner product and limiting behavior at co. Let now Y be the 

complement of {X x X)^ in X x X (that is, the union of Gm-translates of 
the diagonal copy of X), and denote by S{X x X,C^\x\ C^^)y the stalk of 
S{X X X, jC^\x\C^^) over Y. Notice that at this point we have restricted our 
attention to sections of our cosheaves over X xX; that is, standard Schwartz 
sections of £^ \x\ C^^ on X x X. We denote by S{Y-, S -C^^) the fiber of 
S[X X X, C^^) over 1" - it is the space of [x] iZ^-'^-valued Schwartz 
functions on Y . Just for this subsection, we introduce the notation SiyV^) 
for the G-coinvariants oi S{X x X, [x] £^ ). 

For $1 e <l>2 £ i2^^) and a measure dx on X, we define 

the inner product: 

($i,$2) = f («5i-$2)(a;)dx, 
Jx 

i.e. as a bilinear map. Clearly, it extends to a linear functional on S{X x 
X, £^ |x] and for $ in this space we will be using the notation (<l>). 

Given / e 5(VV'^), choose a pair {^,dg) consisting of an element <I> e 
S{X X X,C^^ ^^^) ^i^d a Haar measure on G so that / is obtained as the 
coinvariants of with respect to this measure. The chosen measure on G 
induces a measure on X as follows: let x e X and N = Gx, the stabilizer 
of x; hence, X = N\G. The group N acts by a character ^ on the fiber of 
jC^ over x, and we choose an identification of N{F) with F such that the 
character ^ becomes our fixed additive character ip; we then let dn be the 
Haar measure on N corresponding to our fixed measure dx of §2.3, and we 
let dx be the measure on X corresponding to dg, dn. Clearly, it does not 
depend on the choice of point. 

We then define the "inner product" of / to be the functional: 

(/) = {^) , (4.25) 

where the "inner product" of $ is defined with respect to the measure de- 
scribed above. 

The following is immediate: 

4.9.1. Lemma. The inner product spans the space of G -invariant Junctionals 
on Ix]/:^^) (the fiber of S{X x X,Ci^MC:;i,^) overY). 

Based on Proposition B.4.1 now, the stalk of S{yV^) at ^ = oo is gener- 
ated over the stalk of smooth functions by an element with nonzero "inner 
product" . 

4.9.2. Proposition. The stalk of S(W^) at ^ = co coincides with the set of 
germs of all functions f of the following form: 

• in the nonarchimedean case: 

fiO = Cir') ■ f i^i^x-' - x)dx, (4.26) 

J|x2| = |C| 



30 



YIANNIS SAKELLARIDIS 



where C denotes a(n almost) smooth function*'^ defined in a neigh- 
borhood of zero, with C(0) = (/). 
• in the archimedean case: 

where F is a Schwartz function on Gm x F^, with F(— l,oo) = (/). 

(4.28) 

Remark. It may not be clear at first from the above expressions, but it will 
become clear from the stationary phase analysis of the archimedean integrals 
in §5.2 that the stalks are generated over the stalk of smooth functions by 
a single element, as they should. Thus, we could also write them as C{S,^^) 
times the same integral with F replaced by any preferred function with 
F(— l,oo) = 1. (Jacquet has computed the integrals explicitly in [Jac05], 
and his work will be the basis for the analysis of §5.2.) 

Proof. We can easily see that the germ of / can be written as an integral of 
the form: 

/ 1 X 

where <I> e 5(A^\PGL2, V')] with ijj here denoting the character ( ^ 

il^ix), the measures being the standard ones, and <l>^^^ ^'^^ 

Now we decompose in terms of the Iwasawa decomposition G = NAK, 
where K = PGL2(o) in the nonarchimedean case, and K is the "standard" 
S0(2) or SU(2) in the real and complex case, respectively. 

We can easily see that in the nonarchimedean case, for: 



$(na/c) 

we get: 




if a e ^(o) 
otherwise 



1 



■ip{^x ^ — x)dx. 



Since this particular $ satisfies ^ ]^ ^ ) ^ = 1 0, it generates the 

fiber = stalk of SiyV^) over oo. It is easy to see that for large |.^| only the 
X with l^^l = |,^| contribute (see the proof of Theorem 5.1.1), and this gives 
the desired claim. 



''Notice that this stalk is one dimensional; equivalently, the stalk is generated by such 
functions with C constant. This can be seen by direct computation, or by showing that 
the stalk is generated by the images of locally constant functions "upstairs" . 
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In the archimedean case, the Cartan decomposition reads: 




X 1 

and the matrix ( ^ ^ 1 is obtained as the hmit when x ^ <X), , ,1 , ^ — 1, 
hence the claim. □ 

4.10. Contribution of irregular locus and convergence of orbital 
integrals. Let S <^ X x X he the irregular locus of the map: (4.2.1), that 
is: the set of points {x,x) with x e equal to the image of x under the 
natural map: X ^'F^. 

4.10.1. Proposition. The embedding: 

s{{x xx)\S,c^m z:^') s{x xx,c^m z:^') 

induces an isomorphism on G-coinvariants, that is: 

S{W) = S{{X X X) \ 5, £^1)g. 

This proposition already implies that all the invariant distributions that 
we have defined on S[[X x X) \ 5, 0^^"^) (regular and irregular orbital 
integrals, including the inner product) extend to the whole space; for later 
use, we mention the following (which is easy to see): 

4.10.2. Lemma. In the nonarchimedean case, the regular orbital integrals of 
an element of S{X x X,£^ S^C^"*^) can be decomposed as: 



JN\G Jn 



lN\G JN 

where is a stabilizing integral over large compact open subgroups of N. 

Proof of Proposition 4-10.1. If we fix the stabilizer of a point on X, and 
denote by tjj~^ the character by which it acts on the fiber of JO^^, the problem 
is easily reduced to that of finding (A^~, ■;/')-equivariant distributions on the 
stalk V of S{X, C^) over the unique point y of P"^ fixed by N~ . The notation 
S[X,C^) means similar asymptotics as in §4.5, not sections of over X, 
but it is easy to see that as an A^^-module this stalk has a filtration: 

O^VF^y^P^^O, 

where W is isomorphic to the stalk of smooth sections of over y. 

If S' = {y} cz X, in the notation of appendix B the stalk V of S{X,C^) 
over S' has a separated decreasing filtration hy Vn := JgiV ■ Clearly, the 
group acts trivially on Js'/Jqi = the cotangent space of y, and hence 
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also on Jgi/ Jgi^ = the n-th symmetric power of the cotangent space. More- 
over, recall that is the trivial line bundle over P^. Therefore, there are no 
(iV~ , '0)-equivariant functionals on the n-th graded piece of this filtration, 
which is an image of (actually, isomorphic to): 

JsV^5'^'®5({y},/:^). 

□ 

5. Matching and the fundamental lemma. 
5.1. Matching. 

5.1.1. Theorem. The operator \ »\-Q gives rise to a topological isomorphism: 

S{Z)^S{W), (5.1) 

which satisfies: 

(|-|a/)=7*(r?,0,^)(/), (5.2) 

where { ) denotes the inner products defined in §5.6', 4-9, and ^*{ri,Q,ip) de- 
notes the leading term in the Taylor expansion of the gamma factor -f{r], s,ip) 
around s = 0. 

Proof. We have short exact sequences: 

^ S{X) S{Z) S{Z)/S{X) (5.3) 

and: 

^ I • \S{X) 5(W) ^ 5(W)oo ^ 0. (5.4) 

The arrows on the left are closed embeddings and come from (3.5), where 
we restrict only to sections of M{yi) with smooth orbital integrals - that 
is, we allow singularities only at ^ = 0, not at = —1; and from Corollary 
4.7.2. 

We have already seen that Q is an automorphism of S{X), hence | • \Q 
is an automorphism between the subspaces of the above sequences. There 
remains to see that it induces isomorphisms of the quotients. 

By Corollary 2.7.4 and standard properties of Fourier transform, the 
germs at ^ = of elements of lJ-{S{Z)) are precisely the germs of func- 
tions of the form /i(^) + tp ^0 h{^) with /i, h smooth. Moreover, we claim 

that for iJ-{f) ~ V {^j^ ^(C) (where ~ denotes equality of germs), we have: 

/i(O) =7*(r/,0,V^)(/). (5.5) 

It suffices to prove (5.5) for one element / for which (/) is nonzero. Re- 
call that for (almost) every character x of -F^, considered as a tempered 
distribution on k by meromorphic continuation according to Tate's thesis, 
we have a relation: 

=7(x"\0,V)-|-r'-X"'(-)- (5.6) 
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Indeed, this is just a reformulation of the functional equation for zeta in- 
tegrals; in what follows, we denote the obvious bilinear (not hermitian) 
pairing by angular brackets, and use the exponent ^jJ when Fourier trans- 
form is taken with respect to the character tp, instead of 'ip~^ which is our 
standard convention. We denote Tate's zeta integral of a function (f> e S{F) 

by C{4>,x,s). 



This implies that a function on F which is equal to x(0 ™ ^ neighbor- 
hood of zero (and Schwartz elsewhere) has Fourier transform which is equal^ 
to 'y{x~^j 0, il^)\£,\~^X^^{0 ill ^ neighborhood of infinity (and Schwartz else- 
where). In particular, (5.5) holds for the nonsplit case rj 1. 

For the split case, we can obtain the function — • In |,^| as the limit of: 

t t 

A function which is equal to this in a neighborhood of zero has Fourier 
transform which is equal to — a neighborhood of go, and 
in the limit t — > we obtain 7*(1, — 1,0)|^|~^. 

There remains to show that Fourier transform gives a continuous surjec- 

tion from the set of functions of the form ip /i(^) around ^ = (and 

Schwartz otherwise) to | • times the germs of Kloosterman integrals de- 
scribed in Proposition 4.9.2. It will be an implicit byproduct of the proof 
that, if C is as in the remark following Proposition 4.9.2, then C(0) = /i(0), 
hence {\ • {Gf) = l*{v,0,ij) (f). 

We perform this for the archimedean case in the next subsection. For the 
nonarchimedean case, let us say that /i = Ip. Then: 

J- (^^ (^i^ /i(.)^ (0 = ^(x-i - Cx)dx. 

For 1^1 larger than • (and larger than 1), where c denotes the 
conductor of ip, we claim that only the terms with = |^|~^ contribute. 
Indeed, set u = and v = ^x and assume that |u| > \v\ (the case \u\ < \v\ 
is identical). Then u has norm larger than |p~^c|, and as it varies in a ball of 
radius |p^^c| around some point uq, v varies in a ball of radius less or equal 
than |c| around vq = £,Uq^. Therefore: 

Jip{u — S^u^^)du = 'il){u)du = 0. 



'''Asymptotically equal in the archimedean case, i.e. the quotient by the stated function 
tends to 1. This is proven by an easy argument multiplying the character by a smooth 
cutoff function. 
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Hence, 



V'/ / J|x|2 = |5|-1 



l^r^ f ij{ix-^ - x)dx. 

J|x|2=|£| 



/|x|2=|£| 

5.2. Stationary phase. We complete the proof of matching in the archime- 
dean case, based on the argmnents of [Jac05] . We only discuss the real case, 
as the complex case can be treated similarly. 

5.2.1. Lemma. Let F = M and let (j){u,6) be a Schwartz function in two 
variables. The integral: 



I 



—)^{X{u + u ^))du 

A 



is equal to /i(A) + |A|"ii/;(2A)6'+ {{) + \X\-^ij{-2X)e^ {{) , where h is a 
Schwartz function of X, and 9+ are smooth functions (supported in a neigh- 
borhood of zero ) whose derivatives at zero are polynomials, without constant 
terms, on the derivatives of (j){u,5) at u = +1 (respectively), 6 = 0. In 
particular, 9+{0) depends only on 0(+l,O) (respectively). 

Moreover, in the special case that (j){u,6) = f{u5) for some smooth func- 
tion f , each derivative of 9+ at depends on a finite number of derivatives 
of f at 0, and the germ of 9+ at zero can be arbitrary. Similarly for 9- . 

Proof. This is [Jac05] [Proposition 1], except for the last statement. 
It is proven in [Jac05] that, up to a certain nonzero constant: 

du. 



where is the partial Fourier transform in the variable v = of the 
function: 

<t)iu{v),6) — . 

(We assume without loss of generality that (j) is supported close to n = 1, so 
that the change of variables v = is valid.) 
Hence, 



)M({).J 



(We assume without loss of generality that ip{x) = e^^^*^ 
Therefore: 

It is clear that, if = f{u6), this expression is bounded by a finite number 
of derivatives of / at 0, and that the evaluation of ^^^(0) involves higher 
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derivatives of / at than the evaluation of all ^+(0), k < n. Therefore, the 
map f ^ 0^ is surjective onto the stalk of smooth functions at zero. □ 

This allows us to complete the proof of Theorem 5.1.1 in the real case: 
Indeed, for the by the stationary phase method or the arguments of [Jac05] 
it is easy to see that (4.27) is a Schwartz function of ^ for ^ > or F 
supported away from —1 (in the first variable). For F supported close to 
— 1 and ^ < we can make first the change of variables: t = ^ , and the 
integral (4.27) becomes: 




where Fi is another (arbitrary) smooth function on x P^- Then we can 
make the change u = t to turn this into: 

Fl{-u,t)^p{^/^{u-^ + u))du. (5.7) 

Similarly, for the Fourier transform of a function of the form h{x)'il> (i) 
we have: 

which again by the same arguments depends up to a Schwartz function of ^ 
only on the restriction of /i in a neighborhood of zero, and only for < 0. 
By the change of variables u = —^J—^x we get: 

VW^ J hi{-^f\)^{^au + u-'))du, (5.8) 

where hi is another (arbitrary) smooth function in a neighborhood of zero. 

By the last statement of Lemma 5.2.1, the stalks at zero of (5.7), (5.8) 
coincide. This completes the proof of Theorem 5.1.1. 

□ 

5.3. Basic vectors. From now on, until the end of this section, we assume 
that F is nonarchimedean, E (and hence F) is unramified over the base field 
Qj, or Fp((t)), and endow the groups G, T, N, N~ with smooth group scheme 
structures over the ring of integers 0. We set K = G(o), a hyperspecial 
maximal compact subgroup. The conductor of our fixed self-dual character 
ip is equal to the ring of integers of F. We consider the o-schemes: 

Xi = T\G, X2 = N\G, 

where the latter is equipped with the line bundle defined by and an 
o-identification: ~ Ga- 

We endow the various groups with invariant differential forms defined over 
0, which are nonzero when reduced to the residue field. Based on our fixed 
measure on F of §2.3, this gives rise to invariant measures on their F-points, 
and the F-points of their quotients; these measures are canonical, as they 
do not depend on the choice of differential form. 
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We consider the spaces S{Z) and 5(W) of coinvariants corresponding to 
Xi, resp. X2, as defined previously. We will define distinguished vectors 
fy^ on them, the basic vectors. 

For S{Z) we define: 

f% ■■= the image of lx^{o) ® 1xi(d) in S{Z). (5.9) 

(Having fixed measures on the various groups, this image is a well-defined 
element of S{Z).) 

The description for fy^ will be more complicated, as it is a "nonstandard" 
test function, i.e. not compactly supported. Recall from 4.3 that, in order 
to define orbital integrals for the Kuznetsov trace formula as functions, we 
have chosen a point (xo,yo) £ {X2 x with image 1 e B, and have 

trivialized the fiber of [x] over that point. We now assume that 
{xo-,yo) E {^2 X ^2)^(0), hence after trivializing the fiber and choosing 
suitable o-isomorphisms of the stabilizers with A^, N~ (and of the latter 
with Gq) our sections become elements of C^{N\G x N~\G,il) ® V'"^)- In 
fact, we may trivialize both the fibers of £^ over xq and over to 

consider smooth sections of (resp. of C^^) as elements of C°°(A^\G, -0) 
(resp. C°°(A^-\G,V'"i)). 

For n e N, we denote by Ix^K the section: 



U^K (u {"^^^k] (where ueN,keK) = 1°' ^ '["^ ^ (5.10) 
V \ -L / / \'^)[u)^ otherwise, 



of L^,. As n varies in N, these form a basis for the space of compactly 
supported, K-invariant sections of L^. We similarly define 1^^;^ for ■ 

For an algebraic representation V of the dual group G = SL2, denote by 
hy the element of the spherical Hecke algebra HiG^ K) corresponding under 
the Satake isomorphism: 

-HiG^K) = C[Rep(G)] 

to the representation V . Here the monoid of dominant weights of G is 
isomorphic to N, and we will be writing /i„ for where Vn is the n-th 
highest weight representation. 

The Casselman-Shalika formula states that: 

hn*lxoK = q '^'^x^K- (5.11) 

Let Hg be the formal series in the spherical Hecke algebra which corre- 
sponds under the Satake isomorphism to the L-function: 

L(^,^ + s)L(7r(x)77,i + s). (5.12) 

To understand what this means, we view an L-function L^ir, p, s) (where p 
is a representation of the dual group) as a formal series (in the parameter 
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q^^) of traces of representations: 

00 

L(^,p,s) = 2'?'"to(5V(7r)), 

1=0 

where tt is the Satake parameter of vr, hence the corresponding series in the 
Hecke algebra will be: 

CO 

We then define, for each s: 

$0 := <Pl,ml = {H, * UKm-^K e C°°(^2xX2,£^®£^i)^^^. (5.13) 

To see that Hs * IxqK, a priori a formal series of elements of C^{X2, C^), 
makes sense as a section of when we fix s, write Hg = * /i2,s, where 
hi^s corresponds to the L-function L{tt, | + s) and /i2,s corresponds to L(7r® 
r],^ + s). Recall that for a representation (/>, V) of G, and t e G, we have: 

det(I-g-V(t)|y) = 2 r"^tr/,(t)|sny. (5.14) 

Hence: 

hl,s = 2 9""^'''^^^n> 

where e = +1, according as rj is trivial or not. 

Let Vn denote the highest weight representation of G corresponding to 
the n-th dominant weight, then we have the Klebsch-Gordan formula: 

min(m,n) 

+n-2l- (5.15) 

We use it to compute the convolution of hi^s with h2,s, i-e. to write the 
series: 

\m>0 / \rt>0 / n,m>0 

min(m.n) 

n,m>0 i=0 

Let k = m + n — 21, then the restrictions between the different indices 
correspond to the system: 

/ ^ min(m, n) ^ ^ ^ 2 
m + n = k + 21. 
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To count all m, n for a given k, we add over all Z = 0, 1, . . . and have two 
cases: either m = min(7?T,, n), in which case m ranges over: I ^ m ^ or 
m > min(m, n) in which case n ranges over: I ^ n ^ I + [^^J. Altogether, 
n ranges from / to A; + /. Therefore, the coefficient for will be: 

CO k + l CO 

^-{k+2l){s+\) 2 e" = 2 ^lq-{k+2l){s+\) 

Z=0 n=l 1=0 




Hence, 



^l,s = Hs* IxoK = 2 l_ ^^-2s-l ' ^^r.K 
n=0 



-n{s+l) 




We deduce: 

5.3.1. Lemma. For each fixed s such that 1 — eq^^^^^ 7^ 0, <1>5 ^ makes 
sense as a smooth section of C^. Moreover, for s = we have: $[] e 

s{x X X, c^mc^^). 

Proof. Only the last assertion remains to be proven. We denote by F^^ 
the iC-invariant function on X2 which, under the above trivializations, is 
equal to ^ on diagonal elements; that is, Fi^ is given by the same series, 
but IxnK is replaced by l'^,^^ := the characteristic function of the K-orbit 
represented by diag(ti7"', 1). Then it is easy to see that ^ is the product of 
F^ g by a section of which extends to P^. Therefore, it suffices to prove 
that -F^'q satisfies, in the notation of §4.5: 

(1 - ri(a)^a) • (1 - VE/FS-Ha)-^a) = 0. 
This follows immediately from the fact that ^diag{m"^ ,i)^'x„k ^ ^^^'x„-mK- 

Therefore, we may define the basic vector: 

/^:= theimageof$[!in5(W). (5.17) 

5.4. Fundamental lemma. Finally, we arrive at the "fundamental lemma" 
for elements of the Hecke algebra. Notice that the Hecke algebra 7i[G,K) 
does not act on the quotients S{Z), 5(W). However, the Bernstein center 
does, since these are quotients of G x G representations (and we accept the 
convention that it is the Bernstein center of the first copy of G which acts) . 
The Bernstein center for the component of the spectrum corresponding to 
unramified principal series is isomorphic to ?^(G, K) under the natural map; 
therefore, we will abuse notation to write h*f for h e 'H{G, K) and / e S{Z) 
or <S(W). Of course, this discussion serves only aesthetic purposes and 
is redundant otherwise, as we will only use such expressions for / = the 
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image a, K x /^-invariant function/section $1 (x) $2) and then h* f can be 
interpreted as the image of (/i*<I)i)(x)<^2- 

5.4.1. Theorem. For f% the basic vectors defined in the previous sub- 
section, and all h e "H^GjK), the integral transform \ • \Q satisfies: 



This could be proven by explicit calculations as fohows: On one hand, 
one can explicitly compute the orbital integrals of characteristic functions 
of i^-orbits (or the "characteristic sections" lx„K ® ^y^K previous 
subsection); some of those computations are exhibited in section 6. On the 
other hand, one can use a Casselman-Shalika type formula (which in this 
case is one of the easiest cases of the general formula computed in [Sakb] ) to 
explicitly describe the Hecke action in terms of those characteristic functions. 

Since this is tedious and not particularly informative, but mainly in order 
to demonstrate how the contents of the present paper are simply reflections, 
at the level of orbital integrals, of certain transforms taking place "upstairs" 
at the level of G-spaces plus prior work of Jacquet on the results of Wald- 
spurger, we follow a shortcut; it is important to realize, though, that nothing 
in the present paper depends on the existence of this shortcut, as it could 
be done directly. 

Proof. For the proof we will introduce intermediate "spaces" Zi and Wi 
and we will prove "fundamental lemmas" for each step in the sequence: 



Just for this proof, we write F, Fi,Gi,G for the basic functions that have 
been defined, or will be defined, for the above spaces. 
Symbolically, we have: 



but with different test functions than W. 

More precisely, now, we define S{Zi) as the space of functions on \ 
{0, —1} obtained by orbital integrals of elements of the space: 



We use here the same parametrization for A\G/A as discussed in section 3, 
but since there is a nontrivial character rj we also need to specify represen- 
tatives for the orbits which allow us to think of orbital integrals as functions 
on the regular set of B. For $1 (x) $2 e S{A\G x A\G, 1 ® r/) we define: 



•\G{h*f'^)=h*f\ 



(5.18) 




S{A\G X A\G,l(E)ri). 




(5.19) 
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Throughout we assume smooth o-models for our groups, and Haar mea- 
sures arising from residually nontrivial integral volume forms. The "basic 
function" is, of course, the image of $1 = the characteristic function of 
iA\G){o) and $2(0^) = 7]{a) ior ae A,ke K = G(o), $2 = off AK. 

Jacquet has shown in Proposition 5.1 of [Jac86] that there is a "funda- 
mental lemma for the Hecke algebra" between Z and Zi, that is: 

h*F = h*Fi (5.20) 

for all h e T-L{G,K) and ^ e B^^^ = B \ {0,-1}. The parametrization of 
orbits is different in loc.cit., as are the volumes, but in the end there is no 
need to normalize by volume factors - as can easily be checked by taking 

Now we introduce the space 5(>Vi), or rather just its basic vector Gi. 
This space will consist of the orbital integrals of certain smooth - but not 
Schwartz - sections of £^ [x] over X x X, where X = N\G. The basic 
vector Gi will be obtained from the section $1 (x) $2; where $1 = Hi * IxqK 
and $2 = H2 * lygX) in the notation of §5.3; Here Hi and H2 are the formal 
series in the Hecke algebra corresponding to the L-values: 

Hn,'-) 

and 

L{n(E)r], ^), 

respectively. How to make sense of <I>i, <I>2 as sections is completely analogous 
to the discussion of §5.3. 

We claim that there is a "fundamental lemma for the Hecke algebra" 
between 5(Wi) and <S(W), that is: 

h*Gi=h*G (5.21) 

for all h e 7i(G,K) and e B^ = B^ . It is convenient here to move 
to the domain of convergence by introducing a parameter s, i.e. functions 
Hf defined as before, with the L-values taken at ^ + s instead of ^; we 
let Gf the corresponding function of orbital integrals. Then, writing Hf = 
2„ c(n, s)hn, H2 = Xin ^('^' s)hn, where /i„ is the Hecke element correspond- 
ing to the n-th dominant weight of the dual group, we have: 

h*Gl{^) = c{m,s)d{n,s)0^{h* h,n * lxoK,K * ly^x) 

m.n 

for 3f?(s) large, by the fact that for such s the regular orbital integrals are 
actual, convergent, integrals. 

For an element h in the full Hecke algebra of G, we denote by /i^ its linear 
dual: /i^ {g) = h{g~^). Elements of the spherical Hecke algebra of PGL2 are 
all self-dual. Since orbital integrals are invariant by the diagonal action of 
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G, we get: 

h * GliO = XI c{m, s)d{n, s)0^{hn *h*hm* IxqK, ly^x) = 

m,n 

Finally, using the commutativity of the spherical Hecke algebra, this is 
equal to: 0^{h * Hf* H2* IxoK, ^yt^x) = h* C^. Hence, /i * Gf = /i * C for 
3?(s) large. 

Taking the limit (analytic continuation) as s — > we obtain (5.21). Taking 
the limit is justified as follows: on one hand, the sections Hi * IxqK etc. 
are, by definition, pointwise limits of the sections Hf * IxqK etc. On the 
other, for given ^ and sufficiently large m or sufficiently large n we have 

(^{hm'i-xoK) ® {K * lyoA-)) = 0; this will be seen in §6.3. 

We are left with showing the fundamental lemma for the passage S{Zi) 
5(Wi). To achieve that we will work on the level of spaces, and translate 
the "unfolding" method of Hecke to orbital integrals. 

Let /i e S{A\G,6'), f{ e S{A\G,7]6'). Recah that (5^(diag(a, 1)) = \a\'. 

We define: 

/2(9)= f fling)iJ-\n)dneC'^iN\G,^lJ) 

JN 

and: 

/2(5)= f f[{nwg)i;-\n)dnE C'^^iN-XCij-'), 

JN 

where w = 
We claim: 

5.4.2. Lemma. If fi is the basic function of A\G, i.e. the function supported 
on AK with f[{ak) = 5* (a), then f2 = L{», i + s) * IxqK, where by the L- 
value we mean the corresponding element of the Hecke algebra T-i{G,K). If 
f[ is the basic function of {A\G,rj6^), i.e. the function supported on AK 
with f[{ak) = 7]d^''{a), then f^ = L(7r®7?, ^ + s) * l^^^j^. 

Proof. Assume that tt is an irreducible unramified representation and Wj^ 
the spherical Whittaker function of vr with respect to (iV, -0^^), normalized 
so that VF7r(l) = 1. Since by the Casselman-Shalika formula each 1x„k is 
up to a constant a multiple of hn * IxqK we can write /2 as a formal sum: 

00 

X c(n)/i„ * l^f^K, 

n=0 

SO that if the integral: 

f W^{g)f2{g)dg 

JN\G 
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is convergent, it is equal to: 

2c(n)trK(vr) f W^{g)l,,{g)dg = Yol{N\G{o))Y,c{n)tTVn{TT), 

n n 

where Vn is the n-th irreducible representation of the dual group and tt the 
Satake parameter of vr. Therefore we just need to compute this integral. 
We write: 



f W^{g)f2{g)dg = \ W^{g)h{g)dg 
JN\G JG 



)N\G JG 

= f f W^{ag)5%a)dah{g)dg = \ol{A\G{o)) f W^{ag)rj5'{a)da. 
JA\G J A J A 

It is well-known (and follows easily from the Casselman-Shalika formula) 

that the last integral is absolutely convergent for > — ^, and equal 

to Vol(A(o))L(7r, ^ + s). This implies the claim, since ^°^^^ai(N\G(o))^^°^^ ^ 
Vol(7V(o)) = 1. 

This proves the lemma for /2, and the proof for /2 is identical. □ 

We continue with the proof of Theorem 5.4.1. By the previous lemma, 
when s = 0, we have h * Fi{C) = 0^{fi ® /() and Gi(0 = 0^(/2 (8) f^) 
when /i = /i*(the basic function of {A\G,S^)) and /( =(the basic function 
of {A\G,r]6^)). We want to investigate the relationship between orbital 
integrals for fi (x) and those for /2 ® when s = 0; as before, those will 
be the analytic continuation of the ones for ^{s) » 0, where they are given 
by convergent integrals. We denote the Fourier transform of /i along N: 

h{y,g) = ^^h{ng)'iljy^{n)dn, 

where '^y (^(^^ 1^)^ i^iy^)^ similarly for f[{y,g). 

Clearly, f2{g) = fi{l,g), 12(9) = f[{'i-,wg). Moreover, /i(y, diag(a, l)c/) = 
\a\''^^fi{ay,g) and f{{y,wdiag{a,l){g)) = r]{a)\a\~''''^ f[{a'^y, g). Hence we 
have: 

Odf2J2)= \ fi{l,diag{C,l)g)f[{l,wg)dg = 
JG 

= ler+'f f fi{aC,g)f[{a-\wg)7]{a)dadg 
JA\G JF^ 

The function ^ 1-^ fiio-C, g) /[{ci^^ , wg)ri{a)da can be seen as an orbital 
integral on with respect to the action of the multiplicative group: a ■ 
{x,y) = {ax,a~^y). Thus, we are in the split "baby case" of section 2, 
except that we also have a character r/(a) in the orbital integrals. Moreover, 
we are applying those orbital integrals to the Fourier transform of a Schwartz 
function on (indeed, the restrictions of to unipotent orbits are 

Schwartz functions). We have then seen in 2 (for the case r] = 1, but the 
case 7^ 1 is similar) that: 
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h{ai,g)f'i{a ^,wg)ri{a)da 



It follows that: 



1 ■« 



1 1 
1 

= ier+'a(cH.Oe(/i(x)/()). 

This proves the theorem. □ 

6. Variation with a parameter and explicit calculations 

For global applications we will not be able to use the space of nonstandard 
sections for the Kuznetsov quotient directly. The reason is that, spectrally, 
they correspond to values of L-functions on the critical line, where global 
Euler products are non-convergent. We therefore need to introduce varia- 
tions of this space, corresponding to the parameter s in: 

L{tt, ^ + s)L(7r(x)77, ^ + s). 

We conclude with this, and some explicit calculations. 

6.1. Nonstandard Whittaker space depending on s. We generalize 
the definitions of §4.5 to an arbitrary parameter s e C (the previous case 
corresponding to s = 0), borrowing freely notation from there. 

We let M'{X x X,C^mC~^) (resp. S'{X x X,C^\x\C~^)) denote the 
Schwartz cosheaf over X xX consisting of smooth measures (resp. functions) 
on X X X, valued in jC-,p^C^^, with the following properties: 

• the restriction of the cosheaf to X x X coincides with the standard 
cosheaf of Schwartz measures (resp. functions) valued in £^ (x]>C^^; 

• in a neighborhood of x X they are finite sums of the form fiFi, 
where: 

(1) the /j's are £^ [x] £^^-valued Schwartz functions on X x X; 
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(2) the Fi are scalar-valued measures (resp. functions) on X x X 
which are G-invariant in the second coordinate, and in the first 
coordinate are annihilated asymptotically by the operator: 



2 



a)^a) ■ [1 - VE/FS-^-'ia)^a) . (6.1) 

We let M{W^) denote the G-coinvariants of M'^iXxX, £,/,[x]/:^^). Again, 
using the trivializations of Lemma 4.3.1, we have a map from 7W(W*) to 
measures onB^ . Finally, we identify those with functions on , by dividing 
them by (see the discussion following Lemma 4.4.1), and get the 

local Schwartz space S{yV^) of the Kuznetsov trace formula with parameter 
s, consisting of functions on B^ . This is the space of orbital integrals of 
elements of S^{X x X,C^^ ^^^)- 

6.2. Basic vector. We now come to the setting of §5.3, adopting (until the 
end of the section) all the conventions and notation from there. In particular, 
F is nonarchimedean and we have good integral models, measures, and 
isomorphisms for everything. We only denote here by X what was denoted 
there by X2', namely, the space A^\PGL2. We defined in 5.3 certain sections 

of H-C^^ over X x X. In analogy with Lemma 5.3.1 we have: 

6.2.1. Lemma. The section <I>° belongs to S''{X x X,C^, [x]£^^). 

The proof is identical to that of Lemma 5.3.1. We define fg to be the 
image of in 4S(W^). (In comparison to §5.3, we omit the index vv since 
here we only work on the Kuznetsov space, and introduce the index <j so 
that the previous /{^ is now /q.) 

6.3. Orbital integrals for the characteristic sections. Recall that lx,nK 
denotes a certain compactly supported section of defined in §5.3, and 
1~ a compactly supported section of ■ Now we compute the orbital 
integral: 

for e F^ . We also identify with the representative ^ ^ ^ ^ of N\G/N~ , 

according to §4.3. 
We have: 



JN-\G Jn- 

Vol(X(o)) f h,^K{^n)^~Hn)dn. 

JN- 

Let ^ ^ 1^^"^' ^^^^ admits the following Iwasawa decompo- 

sition (G = NAK): 

• if |x| ^ 1: then e A, n e K; 



BEYOND ENDOSCOPY FOR THE RELATIVE TRACE FORMULA I 



45 



Therefore, 

JN- 

Thus we get: 

. if Id = q-^: O^il,^K0ly,K) = VolX(o); 

• if = g^*^™ for some i > 0: 

(X) 1-^) = Vol X{o) f _ 

• zero otherwise. 

For the integral in the second case, we have l^x"^! = Ixlg^™ ^ |x|. Hence: 

• If m ^ 1 and i > 1 then as x varies in a ball of radius q, ^x^^ varies 
in a ball of radius ^ 1, therefore the integral is zero. 

• If m ^ 1 and z = 1, i.e. \^\ = g^-m ^j^gn as x varies in \ o, 
'ipi^x^^) = 1 and we get: O^Ix^k = - VolX(o). 

• Finally, if m = and 1^ > 1 then we get (with a change of variables 
X ^ -x): O^lx^K = VolX(o) S|^|2=|^| ^(2; - ix-'^)dx. 

To summarize: 

r 1 if lei = g-™; 

Oi{lx^K®ly^,K) = VolX(o)- -1 if lel = ^ 1; 

[ l\x\^=\£^\ i^i^ - Cx-^)dx if \C\ > 1, m = 1. 

(6.2) 

Remark. We notice that for any and sufficiently large m we have O^^Ix^k'S) 
lyoK) = 0. Thus, for an element $ e S'iX x X, C^m jO^p^)^''^ which can 
be written as a series: 

a regular orbital integral 0^{^) can be written as an eventually stabilizing 
series (compare with Lemma 4.10.2): 

0^{<^) = 2 c{m)0^{lx,^K<S)ly^K). 

m>0 
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6.4. Orbital integrals of the basic function. Recall that the basic vector 
fg e S{W^) is obtained by the orbital integrals of $° = {Hg * Ixok) ® lyoi^) 
where Hg is the formal series in the Hecke algebra corresponding to the 
unramified L-factor L(7r, ^ + s)L{tt ® ??, ^ + s). We compute its regular 
orbital integrals, according to the previous remark. 

6.4.1. Lemma. We have: 



= Vol(X(o))L(r?, 2s + 1) (ler+i • (/ - q-^'-'w^-)f{0 + + /C(0) , 



where: 

• /C(^) denotes the function which is supported on |^| > 1 and equal 
to: Jj^p^i^i ^^{x — ^x^^)dx there. (JC stands for "Kloostserman" .) 

• f is the function supported on |^| ^ 1 and equal, there, to: 



• the action of ■nP' is normalized as in (2.14)- 

Proof. Indeed, for given ^ with |^| = g"", the first term expresses the con- 
tributions of lx„K and lxn+2K whenever those are nonzero, according to the 
first two cases of (5.16). However, there is no contribution from IxqK when 
1^1 = g^, and this is what the second term is correcting. The third term 
expresses the contribution of IxoK when |^| > 1. □ 

Appendix A. Almost smooth functions, Schwartz and tempered 



A.l. Almost smooth functions. The space of smooth functions on a real 
manifold has the structure of a Frechet space. We would like, for the pur- 
pose of uniformity, to define a similar Frechet space of functions for a p-adic 
manifold X, i.e. for a topological space equipped with an atlas of "p-adic 
analytic functions" , which is locally isomorphic to the ring of p-adic ana- 
lytic functions on o" (where, as usual o denotes the ring of integers of a 
local nonarchimedean field F). The usual notions of "locally constant" and 
"uniformly locally constant" (when there is some uniform structure) func- 
tions do not lead to Frechet spaces. We are going to define a new class of 
functions, which in this appendix will be called "almost smooth" and in the 
rest of the paper, for simplicity, just "smooth". Also, in this appendix we 
will be denoting the space of these functions by C"^^, but in the rest of the 
paper just by C°°. Finally, for any statement about "almost smooth" func- 
tions in this appendix, when applied to real manifolds, the word "almost" 
should be disregarded; and moreover, complex manifolds and varieties will 
be considered as real manifolds/ varieties. 



(6.3) 




FUNCTIONS 



BEYOND ENDOSCOPY FOR THE RELATIVE TRACE FORMULA I 



47 



Almost smooth functions will form a sheaf for the usual Hausdoff topology 
on X, and therefore it is enough to describe them locally around each point 
X e X. 

We choose an analytic chart for a neighborhood U of x, so that it be- 
comes isomorphic to o" with its ring of analytic functions. Then we identify 
C^~^(U) with C°°+(o"), the space of almost smooth functions on o", defined 
as those complex-valued functions of the form: 

/ = 2/. (A.l) 

on o", where fi is invariant under p* x • • • x p* and for every > there 
is a scalar C such that ||/i||co < Cq^^^ for all i. It is a Frechet space under 
any of the following equivalent systems of seminorms: 

A. 1.1. Lemma. On the space of continuous functions on o", the following 
seminorms define tamely equivalent^ Frechet spaces: 

(1) II/IItv := supi^.i^^gpn q'^\f{x) - K, * f{x)\; 

(2) II/IItv := s^Vi^-i,xeo" q'^\Ki+i * f{x) -Ki* f{x)\; 

(3) ll/lloo, and \\f\\N ■= sup^g^n supygo"x{o} Ivl^^lfix) - f{x + y)\ 
(where = supi\yi\). 

Here Ki is the characteristic measure of x • • • x p*, convolution is in the 
additive group o", and by convention K^i * f = 0. 

It is clear that the Frechet structure is preserved under analytic automor- 
phisms, thus the notion of an almost smooth function on a p-adic manifold 
is well-defined. Notice that, like smooth functions, these "almost smooth" 
functions have vanishing derivatives, for any reasonable notion of "deriva- 
tive" , for instance for any Z e we have: 

t^o \t\ 

Therefore, any statements about derivatives in the nonarchimedean case, 
throughout the paper, should be taken to concern only the zeroth derivative. 
However, we will encode the issue of how fast a function varies in what 
we will call "pseudo-derivatives" , a notion that is related to the seminorms 
defined above. 

A. 2. Semialgebraic sets and charts. We recall that a semialgebraic set 
on a real algebraic variety X is obtained by a boolean combination (i.e. by 
taking unions and complements a finite number of times) of subsets of X(M) 
given by an inequality of the form / ^ 0, where / is a regular function. For 
a smooth algebraic variety X over a nonarchimedean field F, on the other 



Recall that a tame Frechet space is a Frechet space with a presentation as an inverse 
limit of Banach spaces B„, and a map T : lim^ Bn — » lim^ B'„ is tame if there are integers 
6 and r so that for all n ^ b the map T is continuous from Bn+r to B'„. 
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hand, semialgebraic sets are defined as boolean combinations of sets of the 
form: 

{x e X{F)\f{x) e P^], where Pu = {y% e F}, 

/ is a regular function, and k e N^2) cf. [Den86]. By definition, a map: 
X — > y between semialgebraic sets is called semialgebraic if its graph is 
semialgebraic. 

The above sets are the basic closed sets for the restricted topology of semi- 
algebraic sets (restricted means: only finite unions of open sets are required 
to be open), and this is the topology we will be using when talking about 
"open" and "closed" sets and neighborhoods, unless otherwise specified. 

Notice that, in general, the notion of closure is not well-behaved for re- 
stricted topologies. However, for semialgebraic sets the following is true: 
The closure of a semialgebraic set in the usual (Hausdoff) topology is closed 
semialgebraic; hence, the notion of closure is well behaved, and closure in 
semialgebraic topology coincides with closure in the Hausdorff topology. 

By a smooth semialgebraic set we will mean an open subset of the points of 
a smooth variety. (One can more generally define "semialgebraic manifolds" , 
but we will not need this.) For the description of tempered functions, we will 
need to introduce a notion of "semialgebraic chart" for smooth semialgebraic 
set U in the nonarchimedean case. By a semialgebraic chart of U we mean a 
finite partition into open-closed subsets: U = ^jUj and, for every j, a semi- 
algebraic isomorphism aj : Vj — > Uj with an open semialgebraic subset of 
which is -stable (under addition in F"). 

A. 2.1. Lemma. Semialgebraic charts exist. 

Proof. It is easy to see that any smooth semialgebraic set in the nonar- 
chimedean case is isomorphic to a finite disjoint union of open semialgebraic 
subsets of F", so it remains to consider the case that U cz F", in order to 
show that one can find an o"-invariant chart. 

For simplicity, we only show that this is the case for the basic open set 
{x\f{x) ^ Pk} where P^ is the set of k-th. powers of elements of F as above 
and / is a polynomial; the general case is only notationally more compli- 
cated. We may even restrict to the intersection of this set with o", by 
partitioning the set and inverting coordinates as appropriate. Away from 
any neighborhood of the zero set of / (in o") the condition: /(x) ^ Pk is lo- 
cally constant in x, hence uniformly locally constant, hence multiplying the 
coordinates by a suitable scalar will give the required chart. We are left with 
finding an o"-invariant chart for a neighborhood of the zero set Z c o" of /. 
By a resolution of singularities (which will be recalled in the next appendix), 
we can replace a neighborhood of Z by a compact semialgebraic set V of 
the same dimension, so that the pullback of / is, in semialgebraically-local 
coordinates (yi, . . . , ?/„), of the form: c ■ y^^ ■ ■ ■ yl^. Then the claim is easy 
to show. □ 
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A. 3. Schwartz functions. If U is an open semialgebraic subset of (the 
points of) a real or p-adic variety, we will define the space S{U) of Schwartz 
functions on U as a space of smooth (in the archimedean case), resp. al- 
most smooth functions (in the nonarchimedean) . The definition in the 
archimedean case is well-known, but to construct its analog for the nonar- 
chimedean we need to take into account not only the growth of /, but also 
the growth of the summands fi of an expression as in (A.l). For this, we 
will introduce the following analog of differential operators: 

A. 3.1. Definition. Let U be an open subset of the points of a smooth p-adic 
variety and C := {Ui,Vi,ai)i a semialgebraic chart of U. For each almost 
smooth function / on [/ and each ^ we define the N-th pseudoderivative 
of f with respect to C to be equal to / if = 0, and otherwise: 

/'W(x)= sup \y\-^\f{x)-f{x + y)\, (A.2) 

3/G0"\{0} 

where the "sum" x + y should be interpreted in terms of the chart C - i.e. 
it really means: ai{a^^x + y) for x e Ui. 

It is easy to prove: 

A. 3. 2. Lemma. IfC, C denote two different charts, for every N there is a 
semialgebraic function T such that: 

|/'W(x)|^|r(x)|.|/^'W(x)|. 

As a corollary, the notions of Schwartz and tempered functions that we 
are about to define do not depend on the choice of chart; we will omit the 
chart from the notation for pseudoderivatives from now on. 

Now we define Schwartz functions on U . We recall that a "Nash differen- 
tial operator" is a "smooth semialgebraic" differential operator, cf. [AG08]. 
In particular, the growth of these operators is bounded, locally for the semi- 
algebraic topology, by regular functions. 

A. 3. 3. Definition. The space S{U) of Schwartz functions on U consists of 
those smooth functions on ?7, in the archimedean case, resp. almost smooth 
in the nonarchimedean case, with the property: 

• for every Nash differential operator D on [/, in the archimedean 
case, and for every (equivalently: some) chart C, every N ^ {) and 
semialgebraic function T, in the nonarchimedean case, the function 
Z?/, resp. Tf^^\ is bounded. 

The space of Schwartz functions on U is naturally a nuclear Frechet al- 
gebra; its topology is generated by the seminorms: 

sup|Z)/(x)|, 

xeU 

in the archimedean case, where D varies over all Nash differential operators 
(evidently, a countable number of them suffices), and: 

sup|r(x)/W(x)| 
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in the nonarchimedean, where N e N and T varies over all semialgebraic 
functions on U (again, a countable number suffices). 

We will discuss in appendix B cosheaf-theoretic properties of Schwartz 
functions. The following will be a consequence of B. 1.1: 

A. 3. 4. Proposition. Schwartz functions on U are precisely those functions 
which, for one, equivalently any, smooth compactification U of U extend to 
smooth functions (in the archimedean case) resp. almost smooth functions 
(in the non- archimedean case) all of whose derivatives vanish onU \ U. 

We remind that any statement about derivatives should be understood 
to apply only to the zeroth derivative in the nonarchimedean case. 

A. 4. Tempered functions. 

A.4.1. Definition. If U is an open semialgebraic subset of (the points of) a 
smooth real or p-adic variety, we define the space 0{U) of tempered functions 
on U as those smooth (in the archimedean case), resp. almost smooth (in 
the nonarchimedean) functions / on U with the property: 

• In the archimedean case, for every Nash differential operator D on 
U there is a semialgebraic function T on U with \Df\ ^ |T|; in 
the nonarchimedean, for every (equivalently: one) chart C and any 
N e 'N there is a semialgebraic function h on U with l/*-^-*! ^ |r|. 

The space 0(U) of tempered functions on U is an algebra which acts on 
the space of Schwartz functions: 

0{U)®S{U)^SiU). 

Moreover, each / e 0{U) is a bounded operator on S{U). We endow 
0{U) with the strong operator topology on the Frechet space S{U); this way 
it becomes a locally convex topological algebra. By definition, convergence 
to zero of a net {fa)a ^{U) in the strong topology means that /q0 —>■ 
for every (j) e S{U). Since S{U) is a nuclear, and hence Montel Frechet space 
(i.e. bounded sets are precompact), it is known that this topology coincides 
with the operator topology of uniform convergence on bounded/compact 
sets [Kot79, p. 139]. It is easy to describe sequential convergence in this 
topology: 

A. 4. 2. Lemma. For a sequence fn e 0{U) we have fn—*^ iff-' 

(1) /„, in C^{U) (with the usual Frechet topology of locally uniform 
convergence of all derivatives), resp. in C^^(U), and 

(2) for each Nash differential operator D, resp. for each chart C and 
integer N , there is a semialgebraic function T such that: 

\Dfn\ ^ |T|, resp. |/(^)| ^ |T| for all n. 

Proof. It is clear that such a sequence is a null sequence. Vice versa, it is 
clear that a null sequence should converge to zero in C°°{U), resp. C°°"^(C/). 
The proof of the second condition is reduced to tempered functions on F 
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by the resolution of singularities that will be recalled in the next appendix 
(Theorem B.1.2). We prove that all /„ should be bounded by some for 
some N, in a neighborhood of oo (the proof for derivatives/pseudoderivatives 
is similar): if not, there is a Schwartz function (p on F with sup^ \fn{x)(j){x)\ 
bounded below. Thus, /„ cannot be a null sequence. □ 

In particular, 0{U) is sequentially complete. In fact, it can be shown that 
it is a complete, nuclear topological vector space, but we will not use this. 

Appendix B. Schwartz cosheaves 

In this appendix we formalize certain properties of Schwartz functions. 
These properties are obvious for the Schwartz functions themselves, but 
not totally obvious for their coinvariants, hence the language that we are 
introducing is helpful in analyzing orbital integrals. 

From now on, as in the main body of the text, "smooth" function 
means "almost smooth" at nonarchimedean places. Throughout this 
section, X denotes the F-points of a smooth algebraic variety over a local 
field F, "closed" and "open" refer to the restricted topology of semialgebraic 
sets. 

Finally, to avoid repeating the same dichotomy again and again, any 
mention of "a Nash difFerential operator D" should be understood, 
in the nonarchimedean case, as the data consisting of: 

(1) a semialgebraic chart C; 

(2) an integer iV ^ 0; 

(3) a semialgebraic function T. 

Then, a statement about the function Df should be replaced by the analo- 
gous statement about the function \T\f^^\ as in the definition of Schwartz 
functions in Appendix A. On the other hand, we keep our convention that 
any statement about derivatives should be understood to apply 
only to the zeroth derivative in the nonarchimedean case. By con- 
sistently using the phrases "Nash differential operator" and "derivative", 
this should cause no confusion. 

B.l. The sheaf of tempered functions. The association U 0{U), 
where 0{U) denotes the space of tempered functions on U (§A.4), is a sheaf 
of topological algebras on X. We will consider it as the "structure sheaf, 
in the sense that all other sheaves will be modules for it. 

Except for the general sheaf properties, what is interesting for us now is 
the following relation between topology and algebra structure: Any closed 
S <:z X gives rise to the sheaf of ideals Js c O of functions vanishing on S. 
We denote by Jg{U) the closed ideal of OiU) generated by n-fold products 
of elements in JsiJJ); we write K-siU) = n,n.Jg{U). Both Jg and Ks are 
sheaves on X. 
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B.1.1. Lemma. The sheaf Ks is the sheaf of tempered functions which van- 
ish, together with all their derivatives, on S; in particular, in the nonar- 
chimedean case K-s = Js- Equivalently, for each open U <^ X the space 
lCs{U) consists of those tempered functions f on U with the property that 
for any Nash differential operator D on U \ S the function Df is bounded 
in a neighborhood of S nU. 

Before we prove the lemma, we mention a basic tool for our proofs, namely 
the embedded resolutions of singularities, in the following sense: 

B.1.2. Theorem. For every smooth semialgebraic set X and a closed semi- 
algebraic subset S ^ X , there is a smooth semialgebraic set X and a proper 
morphism p : X ^ X , such that: 

(1) p is an isomorphism away from S; 

(2) there is a finite open cover X = |J C/j and, on each Ui, semialgebraic 
coordinates (yi, . . . ,yn) such that S n Ui is given by finite intersec- 
tions and unions of sets of the form: 

{x\f{x)^0}, 

in the (real) archimedean case, and: 

{x\f{x)ePk}, Pfc = {/-|yeF}, 

in the nonarchimedean case, where f = cy^^ ■ ■ ■ y]^ , ij e N. 

This follows from Hironaka's embedded resolution of singularities [Hir64, 
Corollary 3, p. 146]. 

Along with the previous lemma, we will also prove the following, which 
will be useful elsewhere: 

B.1.3. Lemma. Consider a resolution X ^ X as in Theorem B.1.2. Then 
for every open U <^ X with preimage U <^ X , the pullback gives rise to an 
equality: 

Proof of Lemmas B.1.1 and B.1.3. We first prove that an element / e 0{U) 
belongs to all J'g{U) if and only if it vanishes on S n U together with all 
its derivatives. One direction is easy: it is clear that any element of Jg{U) 
has vanishing i-th derivatives, for i ^ n, on all points of S. 

Vice versa, consider a resolution X —> X as in Theorem B.1.2. If ^7 is the 
preimage of U , it is easy to see (by reduction to U = with S = a "stan- 
dard" semialgebraic set defined by conditions on the coordinate functions) 
that if a smooth function vanishes with all its derivatives on 5, it coincides 
locally around each point of S with the restriction of a Schwartz function 
on ?7 \ 5. (We remind again that in the nonarchimedean case there are 
no higher derivatives, so the statement is about almost smooth functions 
vanishing on S.) Let V denote the (closed) subspace of 0{U) consisting of 
such functions; we will eventually prove that it coincides with 1C^{U). 
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To do SO, we use two well-known results in the archimedean case, which 
can be similarly be proven for the nonarchimedean case, for sets as in The- 
orem B.1.2: 

(1) For every Schwartz function (j) on U there is a positive, real-valued 
Schwartz function ip on the same space such that ^ is a Schwartz 
function. 

(2) Every Schwartz function (j) on U \ S is a product of two Schwartz 
functions on the same space. 

From this it can immediately be deduced that any f ^ V can be written 
as a limit of fipa , where ipa runs over a suitable system of positive Schwartz 
functions on U, directed by majorization; and that every fipa is the product 
of two Schwartz functions on [/ \ S". But Schwartz functions on [/ \ 
belong to V, hence the multiplication map: V <SiV ^ V has dense image. 
Since V cz Jg{U), it follows that V cz J'?[U); repeating this argument, 

V cz J'^iJJ) for all n. Hence V cz /C^(C/), therefore these spaces are equal. 

Now, there is a sequence of natural numbers kn +oo such that a smooth 
function on U which vanishes with all its first n derivatives on S nil descends 
to a function on U which vanishes with all its first kn derivatives on S nU 
(vice versa, if the first n derivatives of a function on U vanish on S then 
they also vanish for the pullback to U). This implies that elements of ICs{U) 
descend to smooth functions on U with vanishing derivatives on S. Notice 
that the pullback of 0{U) is closed in 0{U), and the topologies coincide 
(indeed, since the map X ^ X is proper, it suffices for defining the topology 
on 0(U) to consider only those Schwartz functions on U which are pullbacks 
of Schwartz functions on U). Again by the fact that /C_g(C/)^ is dense in 
/C^(C/) we deduce that /C^(C/) ^ J^{U) for all n, hence }Cg{U) = }Cs{U). □ 

Now notice that we have an injective map: lCs{U) 0{U \ S). 

B.1.4. Lemma. There is a sequence {un)n ^siP) with: 

Un^lin 0{U\S). 

We will call such a sequence an approximate identity, despite the fact that 
it is only bounded in the weaker topology of 0{U \ S), because it satisfies: 

n„/^/for aWfeKsiU). 

Proof. We may choose a countable, increasing open cover [/„ of U with the 
property that the complement of Un contains a neighborhood of UnS. Then 
we can find a sequence of tempered functions n.„ e ICs{U), with Un\un = 1 
and the property that for every Nash differential operator D onU there 
is a semialgebraic function T on U \ S" such that |-Dtin| ^ \T\ for all n. 
(Again, this is easier to see with a blowup as in Theorem B.1.2.) By Lemma 
A. 4. 2, the limit of this sequence in 0{U \ S) is the constant function 1. □ 

We denote the quotient sheaf Os '■= 0/K,s- It is supported on S. Notice 
that for every quotient of O by an ideal subsheaf X, the map: 0{U) — > 
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{0/X)(U) is surjective for every U ; thus, no sheafification is needed. Indeed, 
using a partition of unity as in [AG08, Theorem 5.2.1], we can patch func- 
tions fi on a finite cover U = (J j f^i , which agree on intersections modulo X, 
to a function / e 0{U) whose restriction to Ui is = /j mod X{Ui). 

B.1.5. Lemma. The sheaf Os can also he described as the completion of O 
over the closed subset S: 

Os = \iraO/J^. (B.l) 

Proof. In the nonarchimedean case we have seen that Ks = Js-, so the 
statement is trivial. We discuss the archimedean case. 

First of all, we use a resolution X ^ X as in Theorem B.l. 2. Then we 
have, for every U , a commutative diagram of injective maps: 

0/lCs{UY lim^ 0/J^{U) 

r\ n 

O/ICMU)^ lim^ O/J^'iU) 

Let us fix a sequence Di of Nash differential operators which generate all 
Nash differential operators over the ring of Nash (i.e. smooth semialgebraic) 
functions, for the set U. An element of lim^ 0/J'^{U) can be described 

(non-uniquely) by a sequence e 0{U) with the property: for all i ^ n 
we have Difn\a = Difi\d- The topology on Ynn.^ O/ J'^{U) is given by 
seminorms: 

SUp|r(x)A('^/n)(2;)|, 

xeS 

where T varies over semialgebraic functions on S and (f) varies over elements 
oiS{U). 

It is then elementary to construct (by appropriate Taylor series) a smooth, 
tempered function / on [/ with Dif\g = Difi\g for all i. Moreover, for every 
<j) e <S(U) the construction of / can be made such that \\Di{f(l))\\L^{u) is 
bounded in terms of a finite number of seminorms of the form: 

snv\T{x)Dj{(t)j fn){x)\, 
xeS 

where T is semialgebraic and e S{U). Thus, the bottom horizontal arrow 
of the above diagram is an isomorphism. 

But if the given element of 0/J'^{U) comes from 0/Jg{U), all the deriva- 
tives of the constructed function / agree on S\ therefore, it descends to an 
element of 0{U). In other words, the vertical arrows are closed embeddings 
into the same subspace, and this proves the claim. □ 
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B.2. Schwartz cosheaves. By a Schwartz cosheaf on X we will mean a 
cosheaf J- of nuclear Frechet spaces on X, satisfying certain axioms. The 
extension maps will be denoted by ey (where V <^ U are open subsets), or 
simply by e when the source and target are clear. We will sometimes call the 
extension maps "extension by zero" , to emphasize their geometric meaning. 
The axioms are expressed in terms of an arbitrary open subset U (as I do 
not see a way to make them "sheaf-theoretic" combining the presence of a 
sheaf and a cosheaf), and are the following: 

(1) The extension maps Cy : T{V) J^{U) are closed. 

(2) J-{U) is a continuous C'(?7)-module, i.e. there is a continuous bilinear 
map: 

0{U) X F{U) F{U) 

compatible with multiplication on 0{U). 

(3) If 5 X is closed, sections of F vanishing to arbitrary degree on S 
are extensions by zero of sections on the complement of 5, that is: 
if Js denotes the sheaf of ideals of tempered functions vanishing on 
S as before then: 

[\jfFm^e{F{U^S)). (B.2) 

n 

(We will prove equality in the next lemma.) 

(4) Obvious compatibility conditions: liV<^U are open then the dia- 
gram commutes: 

0{U) (X) F{U) ^J'iU) 

' V V V 

0{V) ® F{V) ^F{V). 

B.2.1. Lemma. Let {un)n be a weak approximate identity in ICs{U) as in 
Lemma B.I.4, then Unf f for every f ^ ey {F{U \ S)). Consequently: 

n J^HU) = e {F{U \ S)) = lCsF{U). 

n 

Proof. Let V = U \ S . Since the map OiV) x FiV) ^iV) is continuous, 
and tin ^ 1 in ©(F), we have n„,/ f for every / e F{V). By the 
compatibility of restrictions and corestrictions (fourth axiom), Uney{f) is 
the same as ey{unf), and since Cy is continuous, this tends to ey{f) for all 
feFiV). 

But UnC^if) e )Cs{e^F{V)) c J^F{U) for ah n, hence the claim. □ 

B.3. Functoriality. In what follows, we consider only morphisms between 
smooth semialgebraic sets. For a morphism ir : X ^ Y, and a cosheaf F on 
X, the push-forward vr^^ J-" is simply the cosheaf: V ^ F{ir^^V). 

B.3.1. Lemma. The push-forward of a Schwartz cosheaf is a Schwartz cosheaf. 
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Proof. The only nontrivial verification is that of the third axiom. Let 
TT : X — > y be a morphism and denote for clarity by Ox and Oy the 
corresponding sheaves of tempered functions. Let 5 c: y be a closed subset, 
and ICs,IC„~T-s tlie corresponding sheaves on Y and X, respectively. 

The third axiom for implies that for every open V Y we have an 
equality: 

n 

In particular, since J^si^) J'TT-'^si'^^^^)^ S^*: 

r\J^{V)-7r^TiV) cz e {n^J^iV \ S)) . 

n 

But by the proof of Lemma B.2.1, we have: 

e (7r,7-(y \ S)) cz }Cs{V) ■ tt,T{V), 

and of course )Cs{V) ■ 7ripT{V) a f]^ Jgi^) ' 7r=^J^(y). Hence, all these three 
spaces coincide. □ 

B.4. Stalks, fibers and a Nakayama-type lemma. Given a closed 5 cz 
X we define the stalk of a Schwartz cosheaf over S to be the cosheaf: 

Fs = Tie {Tx-^s) , 

where Tx^s is the cosheaf: Tx^s{U) = T{U \ 5). Clearly, Ts is zero on 
X \ 5"; in that sense, it is supported on 5. 

Let now Os be the quotient Oj Jg - it is the sheaf of restrictions to 5 of 
(smooth) tempered functions on O, and it satisfies Os{U) = 0{U)/ JgiU). 
The fiber of F will be the cosheaf: Ts{U) = T{U)/ Js{U)T{U). Of course, 
in the nonarchimedean case the fiber and the stalk coincide. In the archimedean 
case, we will use the following version of Nakayama's lemma: 

B.4.1. Proposition. Let S =a point (hence Os{U) = C for every U zd S), 
and assume that a finite-dimensional subspace N cz J-{U) spans the fiber 
FsiJJ). Then the same subspace algebraically (i.e. without taking closures) 
generates Ts{U) as an Os{U) -module. 

Proof For s implicity of notation, M := FsiJJ), R = Os{U), J = Js{U), 
Mn = J'^M. Notice that by the third axiom for Schwartz cosheaves, M is 
separated with respect to the J-adic topology, i.e. we have an embedding: 

M ^ lim M/M„. 

n 

We claim that for every n the map J" <S) N Mn/Mn+i is surjective. 
Indeed, we have a natural map with dense image: 

but since the space on the left is finite dimensional, the map is surjective. 
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This implies that the map {R/ J"^) i^N —>■ M/Mn is surjective, and hence 
so is the map: 

hm(i?/J") (X) iV ^ hm M/M„. 

71 n 

Since is finite-dimensional, the left hand side is equal to A^(x)lim^ R/J'^, 
which is equal to N<S)R by Lemma B.1.5. Therefore generates lim^ M/Mn 

algebraically over i?, and in particular M = lim^ M/Mn- D 

B.5. Group actions. Let J- he & Schwartz cosheaf on a smooth F-variety 
X, and assume that it carries an action of a group G. (The group G is 
assumed to act trivially on X] for example, if Y is an affine G-variety, with 
G reductive, X = Y // G and Q is a, cosheaf on Y with a compatible G-action, 
then F could be the push- forward oi Q.) 

We let J-Q denote the cosheaf of G-coinvariants, that is: 

where T{U)g denotes the quotient of T{U) by the closed subspace generated 
by vectors of the form v — gv, v e J'(U). 

B.5.1. Proposition. The cosheaf is a Schwartz cosheaf. For every two 
open sets V <^U , the map: [eyFiy)^ ^ J-g{U) is a closed embedding. 

Proof. The only nontrivial axiom to check is the closedness of extension 
maps, therefore it suffices to prove the second statement. Let Mi = eyT{V), 
M2 = J^{U), and let A'j, z = 1,2, be the subspace of Mj algebraically spanned 
by elements of the form v—g-v, v e Mj. We need to prove that for a sequence 
fi /) where fi e A''2 and / e Mi, we have f e Ni. 

Choose an approximate identity Un e ICu^v{U) (Lemma B.1.4). Then we 
have: lim„ u„/ = / (Lemma B.2.1). We also have limjM„/j = Unf for every 
i; thus, / e {unfi)n,i ^ Ni. □ 

In applications to the present paper, all Schwartz cosheaves that we will 
encounter are flabby, i.e. the extension maps are monomorphisms (hence 
closed embeddings, by the first axiom). The last proposition implies: 

B.5.2. Corollary. In the above setting, the cosheaf of G-coinvariants of a 
flabby Schwartz cosheaf is flabby. 
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